![[Jenkins]](/jenkins/static/b68c8964/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30049 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37203 originally caused by: Started by upstream project "master-osmo-iuh" build number 12854 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29271 originally caused by: Started by upstream project "master-osmo-msc" build number 34219 originally caused by: Started by upstream project "master-osmo-iuh" build number 12854 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17660 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6681 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8947 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2957 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29271 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5152 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30049 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4677 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12971 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9242 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5191 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3909 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins6485082113163505677.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-10 12:41:51 + trial_dir_prefix=trial- + rm -rf trial-2374 trial-2374-bin.tgz trial-2374-run.tgz + trial_dir=trial-2375 + mkdir -p trial-2375 + mv open5gs.build-8.tgz osmo-bsc.build-17660.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6681.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2957.tgz osmo-mgw.build-8947.tgz osmo-msc.build-29271.tgz osmo-nitb.build-12971.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30049.tgz osmo-stp.build-9242.tgz osmo-trx.build-4677.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz trial-2375 + cat open5gs.build-8.md5 osmo-bsc.build-17660.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6681.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2957.md5 osmo-mgw.build-8947.md5 osmo-msc.build-29271.md5 osmo-nitb.build-12971.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30049.md5 osmo-stp.build-9242.md5 osmo-trx.build-4677.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17660.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6681.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2957.md5 osmo-mgw.build-8947.md5 osmo-msc.build-29271.md5 osmo-nitb.build-12971.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30049.md5 osmo-stp.build-9242.md5 osmo-trx.build-4677.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2375 combinations: None trial: 'trial-2375' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2375 -------------------------------------------------------------------------------------------- 12:42:03.426601 tst trial-2375: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/log --------------------------------------------------------------------- trial-2375 nitb_sms:sysmo --------------------------------------------------------------------- 12:44:09.571809 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:44:09.576079 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 12:44:09.596789 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 12:44:09.604659 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 12:44:09.656758 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 12:44:09.677311 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 12:44:09.683906 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 12:44:10.222437 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 12:44:10.227300 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 12:44:10.238074 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 12:44:10.607644 tst mo_mt_sms.py: using LAC 28479 12:44:10.845154 tst mo_mt_sms.py: using RAC 174 12:44:10.963752 tst mo_mt_sms.py: using CellId 28479 12:44:11.082697 tst mo_mt_sms.py: using BVCI 28480 12:44:11.193526 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 12:44:11.376858 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 12:44:11.497963 tst mo_mt_sms.py:9: start nitb and bts... 12:44:11.718571 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:44:14.085629 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9212): Launched 12:44:14.418725 run osmo-nitb_10.42.42.2(pid=9213): Launched 12:44:14.597574 run osmo-nitb_10.42.42.2(pid=9213): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9213)] 12:44:14.732541 run osmo-nitb_10.42.42.2(pid=9213): stdout: | (launched: 2022-12-10_12:44:14.357022) 12:44:14.869374 run osmo-nitb_10.42.42.2(pid=9213): stderr: | (launched: 2022-12-10_12:44:14.406399) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:44:15.005725 run osmo-nitb_10.42.42.2(pid=9213): stdout: | (launched: 2022-12-10_12:44:14.357022) 12:44:15.135533 run osmo-nitb_10.42.42.2(pid=9213): stderr: | (launched: 2022-12-10_12:44:14.406399) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:44:15.291930 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9213): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9213) [trial-2375↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9213)] [trial-2375↪nitb_sms:sysmo↪mo_mt_sms.py:11] 12:44:15.300884 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 12:44:15.308091 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9212): Terminating (SIGTERM) 12:44:15.518991 --- ParallelTerminationStrategy: PID 9212 died... 12:44:15.540692 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9212): Terminated: ok {rc=0} 12:44:15.629225 bus /sierra_3: Setting Powered False 12:44:16.734101 bus /sierra_3: Setting Powered False 12:44:17.855769 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 sms:sysmo --------------------------------------------------------------------- 12:44:19.034392 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:44:19.038320 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 12:44:19.059204 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 12:44:19.086323 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 12:44:19.140044 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 12:44:19.161445 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 12:44:19.187973 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 12:44:19.735819 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 sms:sysmo mo_mt_sms.py ---------------------------------------------- 12:44:19.741375 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:44:19.752377 tst sms:sysmo: Using 1 x bts (candidates: 1) 12:44:19.791284 tst mo_mt_sms.py: using LAC 28480 12:44:19.919429 tst mo_mt_sms.py: using RAC 175 12:44:20.045971 tst mo_mt_sms.py: using CellId 28480 12:44:20.172847 tst mo_mt_sms.py: using BVCI 28481 12:44:20.292021 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:44:20.302969 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:44:20.313965 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:44:20.324693 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:44:20.335650 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:44:20.346603 tst sms:sysmo: Using 1 x modem (candidates: 2) 12:44:20.463648 tst sms:sysmo: Using 1 x modem (candidates: 2) 12:44:20.586566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:22.360688 run create_hlr_db(pid=9219): Launched 12:44:22.495807 bus /sierra_2: Setting Powered False 12:44:23.561285 run create_hlr_db(pid=9219): Terminated: ok {rc=0} 12:44:24.003461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9221): Launched 12:44:24.315693 run osmo-hlr_10.42.42.2(pid=9222): Launched 12:44:24.434954 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:26.908442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9224): Launched 12:44:27.221124 run osmo-stp_10.42.42.5(pid=9225): Launched 12:44:27.341215 run osmo-msc_10.42.42.6: Starting osmo-msc 12:44:32.649378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9227): Launched 12:44:32.961098 run osmo-msc_10.42.42.6(pid=9228): Launched 12:44:33.131277 run osmo-stp_10.42.42.5(pid=9225): ERR: Terminated: ERROR {rc=1} [trial-2375↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9225)] 12:44:33.260833 run osmo-stp_10.42.42.5(pid=9225): stdout: | (launched: 2022-12-10_12:44:27.162521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:33.391188 run osmo-stp_10.42.42.5(pid=9225): stderr: | [0;m[38;5;43m20221210124427338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124427338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124427338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124427339 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124427339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124427339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124427339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:33.519417 run osmo-stp_10.42.42.5(pid=9225): stdout: | (launched: 2022-12-10_12:44:27.162521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:33.641437 run osmo-stp_10.42.42.5(pid=9225): stderr: | [0;m[38;5;43m20221210124427338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124427338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124427338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124427339 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124427339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124427339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124427339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:33.787723 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9225): Process ended prematurely: osmo-stp_10.42.42.5(pid=9225) [trial-2375↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9225)] [trial-2375↪sms:sysmo↪mo_mt_sms.py:16] 12:44:33.796048 tst mo_mt_sms.py:16: Test FAILED (14.0 sec) 12:44:33.822459 run osmo-hlr_10.42.42.2(pid=9222): ERR: Terminated: ERROR {rc=237} [trial-2375↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9222)] 12:44:33.871251 run osmo-hlr_10.42.42.2(pid=9222): stdout: | (launched: 2022-12-10_12:44:24.256897) 12:44:33.921559 run osmo-hlr_10.42.42.2(pid=9222): stderr: | [0;m[1;31m20221210124424435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124424435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124424435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124424435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124424435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124424435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124424489 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124424498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124424498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124424498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:33.991252 run osmo-msc_10.42.42.6(pid=9228): ERR: Terminated: ERROR {rc=2} [trial-2375↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9228)] 12:44:34.040155 run osmo-msc_10.42.42.6(pid=9228): stdout: | (launched: 2022-12-10_12:44:32.902944) 12:44:34.090544 run osmo-msc_10.42.42.6(pid=9228): stderr: | [0;m[38;5;43m20221210124433180 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124433180 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f046cc56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124433180 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124433180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124433180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124433181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124433183 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124433184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124433184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124433184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:44:34.141385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9221): Terminating (SIGTERM) 12:44:34.181827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9224): Terminating (SIGTERM) 12:44:34.222305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9227): Terminating (SIGTERM) 12:44:34.262961 --- ParallelTerminationStrategy: PID 9221 died... 12:44:34.282240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9221): Terminated: ok {rc=0} 12:44:34.327162 --- ParallelTerminationStrategy: PID 9224 died... 12:44:34.345933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9224): Terminated: ok {rc=0} 12:44:34.391162 --- ParallelTerminationStrategy: PID 9227 died... 12:44:34.410080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9227): Terminated: ok {rc=0} 12:44:34.498618 bus /sierra_3: Setting Powered False 12:44:35.600890 bus /sierra_3: Setting Powered False 12:44:36.718690 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_ussd:sysmo --------------------------------------------------------------------- 12:44:37.939201 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:44:37.942849 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 12:44:37.963326 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 12:44:37.970841 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 12:44:38.004892 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 12:44:38.025487 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 12:44:38.032711 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 12:44:38.553994 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2375 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 12:44:38.559601 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 12:44:38.570898 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 12:44:38.605958 tst assert_extension.py: using LAC 28481 12:44:38.736405 tst assert_extension.py: using RAC 176 12:44:38.865462 tst assert_extension.py: using CellId 28481 12:44:38.995681 tst assert_extension.py: using BVCI 28482 12:44:39.116547 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 12:44:39.231105 tst assert_extension.py:10: start nitb and bts... 12:44:39.437674 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:44:40.066263 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9234): Launched 12:44:40.376923 run osmo-nitb_10.42.42.2(pid=9235): Launched 12:44:40.549140 run osmo-nitb_10.42.42.2(pid=9235): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9235)] 12:44:40.687327 run osmo-nitb_10.42.42.2(pid=9235): stdout: | (launched: 2022-12-10_12:44:40.318533) 12:44:40.826867 run osmo-nitb_10.42.42.2(pid=9235): stderr: | (launched: 2022-12-10_12:44:40.364505) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:44:40.968081 run osmo-nitb_10.42.42.2(pid=9235): stdout: | (launched: 2022-12-10_12:44:40.318533) 12:44:41.103903 run osmo-nitb_10.42.42.2(pid=9235): stderr: | (launched: 2022-12-10_12:44:40.364505) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9235): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9235) [trial-2375↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9235)] 12:44:41.494943 tst osmo-nitb_10.42.42.2(pid=9235): stdout: | (launched: 2022-12-10_12:44:40.318533) 12:44:41.618148 tst osmo-nitb_10.42.42.2(pid=9235): stderr: | (launched: 2022-12-10_12:44:40.364505) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:44:41.765208 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9235): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9235) [trial-2375↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9235)] [trial-2375↪nitb_ussd:sysmo↪assert_extension.py:12] 12:44:41.773523 tst assert_extension.py:12: Test FAILED (3.2 sec) 12:44:41.780235 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9234): Terminating (SIGTERM) 12:44:41.991708 --- ParallelTerminationStrategy: PID 9234 died... 12:44:42.012529 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9234): Terminated: ok {rc=0} 12:44:42.100887 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 ussd:sysmo --------------------------------------------------------------------- 12:44:43.315935 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:44:43.320853 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 12:44:43.343328 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 12:44:43.370698 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 12:44:43.407286 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 12:44:43.428343 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 12:44:43.455552 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 12:44:43.983367 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2375 ussd:sysmo assert_extension.py ---------------------------------------------- 12:44:43.988474 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:44:43.999570 tst ussd:sysmo: Using 1 x bts (candidates: 1) 12:44:44.037746 tst assert_extension.py: using LAC 28482 12:44:44.166497 tst assert_extension.py: using RAC 177 12:44:44.296877 tst assert_extension.py: using CellId 28482 12:44:44.426350 tst assert_extension.py: using BVCI 28483 12:44:44.547295 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:44:44.558419 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:44:44.569311 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:44:44.580697 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:44:44.592148 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:44:44.603457 tst ussd:sysmo: Using 1 x modem (candidates: 1) 12:44:44.721535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:45.201617 run create_hlr_db(pid=9242): Launched 12:44:45.321725 bus /sierra_2: Setting Powered False 12:44:46.404780 run create_hlr_db(pid=9242): Terminated: ok {rc=0} 12:44:46.950494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9244): Launched 12:44:47.283451 run osmo-hlr_10.42.42.2(pid=9245): Launched 12:44:47.403698 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:47.938668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9247): Launched 12:44:48.252146 run osmo-stp_10.42.42.5(pid=9248): Launched 12:44:48.370613 run osmo-msc_10.42.42.6: Starting osmo-msc 12:44:48.928011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9250): Launched 12:44:49.241345 run osmo-msc_10.42.42.6(pid=9251): Launched 12:44:49.417268 run osmo-stp_10.42.42.5(pid=9248): ERR: Terminated: ERROR {rc=1} [trial-2375↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9248)] 12:44:49.551050 run osmo-stp_10.42.42.5(pid=9248): stdout: | (launched: 2022-12-10_12:44:48.193448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:49.683288 run osmo-stp_10.42.42.5(pid=9248): stderr: | [0;m[38;5;43m20221210124448370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124448370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124448371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124448371 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124448371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124448372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124448372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:49.813261 run osmo-stp_10.42.42.5(pid=9248): stdout: | (launched: 2022-12-10_12:44:48.193448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:49.936673 run osmo-stp_10.42.42.5(pid=9248): stderr: | [0;m[38;5;43m20221210124448370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124448370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124448371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124448371 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124448371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124448372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124448372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:50.085168 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9248): Process ended prematurely: osmo-stp_10.42.42.5(pid=9248) [trial-2375↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9248)] [trial-2375↪ussd:sysmo↪assert_extension.py:17] 12:44:50.093643 tst assert_extension.py:17: Test FAILED (6.1 sec) 12:44:50.120278 run osmo-hlr_10.42.42.2(pid=9245): ERR: Terminated: ERROR {rc=237} [trial-2375↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9245)] 12:44:50.169090 run osmo-hlr_10.42.42.2(pid=9245): stdout: | (launched: 2022-12-10_12:44:47.223854) 12:44:50.219460 run osmo-hlr_10.42.42.2(pid=9245): stderr: | [0;m[1;31m20221210124447403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124447403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124447403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124447403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124447403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124447403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124447598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124447606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124447607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124447607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:50.289648 run osmo-msc_10.42.42.6(pid=9251): ERR: Terminated: ERROR {rc=2} [trial-2375↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9251)] 12:44:50.338625 run osmo-msc_10.42.42.6(pid=9251): stdout: | (launched: 2022-12-10_12:44:49.182560) 12:44:50.389142 run osmo-msc_10.42.42.6(pid=9251): stderr: | [0;m[38;5;43m20221210124449457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124449458 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30580adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124449458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124449458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124449458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124449458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124449461 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124449462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124449462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124449462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:44:50.440123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9244): Terminating (SIGTERM) 12:44:50.480851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9247): Terminating (SIGTERM) 12:44:50.521484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9250): Terminating (SIGTERM) 12:44:50.562202 --- ParallelTerminationStrategy: PID 9244 died... 12:44:50.581466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9244): Terminated: ok {rc=0} 12:44:50.626206 --- ParallelTerminationStrategy: PID 9247 died... 12:44:50.644826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9247): Terminated: ok {rc=0} 12:44:50.689913 --- ParallelTerminationStrategy: PID 9250 died... 12:44:50.708484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9250): Terminated: ok {rc=0} 12:44:50.793580 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:44:51.994134 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:44:52.003118 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:44:52.024792 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:44:52.051840 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:44:52.103997 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:44:52.125355 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:44:52.152355 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:44:52.705156 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:44:52.759783 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:44:52.771217 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:44:52.829287 tst mo_mt_call.py: using LAC 28483 12:44:52.963428 tst mo_mt_call.py: using RAC 178 12:44:53.095651 tst mo_mt_call.py: using CellId 28483 12:44:53.225338 tst mo_mt_call.py: using BVCI 28484 12:44:53.347965 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:44:53.359558 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:44:53.370852 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:44:53.382291 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:44:53.393632 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:44:53.405069 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:44:53.523041 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:44:53.644401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:54.166090 run create_hlr_db(pid=9256): Launched 12:44:54.305471 bus /sierra_2: Setting Powered False 12:44:55.371823 run create_hlr_db(pid=9256): Terminated: ok {rc=0} 12:44:55.820041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9258): Launched 12:44:56.138457 run osmo-hlr_10.42.42.2(pid=9259): Launched 12:44:56.260055 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:56.813813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9261): Launched 12:44:57.131002 run osmo-stp_10.42.42.5(pid=9262): Launched 12:44:57.253368 run osmo-msc_10.42.42.6: Starting osmo-msc 12:44:57.822960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9264): Launched 12:44:58.140662 run osmo-msc_10.42.42.6(pid=9265): Launched 12:44:58.319047 run osmo-stp_10.42.42.5(pid=9262): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9262)] 12:44:58.453490 run osmo-stp_10.42.42.5(pid=9262): stdout: | (launched: 2022-12-10_12:44:57.071120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:58.586650 run osmo-stp_10.42.42.5(pid=9262): stderr: | [0;m[38;5;43m20221210124457247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124457247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124457247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124457248 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124457248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124457248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124457248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:58.717969 run osmo-stp_10.42.42.5(pid=9262): stdout: | (launched: 2022-12-10_12:44:57.071120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:58.842374 run osmo-stp_10.42.42.5(pid=9262): stderr: | [0;m[38;5;43m20221210124457247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124457247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124457247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124457248 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124457248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124457248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124457248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:58.991935 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9262): Process ended prematurely: osmo-stp_10.42.42.5(pid=9262) [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9262)] [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:44:59.000782 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:44:59.027756 run osmo-hlr_10.42.42.2(pid=9259): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9259)] 12:44:59.077454 run osmo-hlr_10.42.42.2(pid=9259): stdout: | (launched: 2022-12-10_12:44:56.078937) 12:44:59.128191 run osmo-hlr_10.42.42.2(pid=9259): stderr: | [0;m[1;31m20221210124456258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124456258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124456258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124456258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124456258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124456258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124456273 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124456281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124456282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124456282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:59.198734 run osmo-msc_10.42.42.6(pid=9265): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9265)] 12:44:59.247583 run osmo-msc_10.42.42.6(pid=9265): stdout: | (launched: 2022-12-10_12:44:58.081054) 12:44:59.297789 run osmo-msc_10.42.42.6(pid=9265): stderr: | [0;m[38;5;43m20221210124458358 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124458358 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc1122c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124458358 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124458358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124458358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124458359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124458360 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124458361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124458361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124458361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:44:59.348912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9258): Terminating (SIGTERM) 12:44:59.389510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9261): Terminating (SIGTERM) 12:44:59.430186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9264): Terminating (SIGTERM) 12:44:59.470856 --- ParallelTerminationStrategy: PID 9258 died... 12:44:59.490295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9258): Terminated: ok {rc=0} 12:44:59.535445 --- ParallelTerminationStrategy: PID 9261 died... 12:44:59.554251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9261): Terminated: ok {rc=0} 12:44:59.599065 --- ParallelTerminationStrategy: PID 9264 died... 12:44:59.617798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9264): Terminated: ok {rc=0} 12:44:59.703421 bus /sierra_3: Setting Powered False 12:45:00.802703 bus /sierra_3: Setting Powered False 12:45:01.956725 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:45:03.123748 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:45:03.135903 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:45:03.194182 tst mo_mt_call_osmux.py: using LAC 28484 12:45:03.327893 tst mo_mt_call_osmux.py: using RAC 179 12:45:03.461033 tst mo_mt_call_osmux.py: using CellId 28484 12:45:03.596207 tst mo_mt_call_osmux.py: using BVCI 28485 12:45:03.720220 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:45:03.731907 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:45:03.743218 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:45:03.754563 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:45:03.765995 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:45:03.777376 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:45:03.894759 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:45:04.018168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:04.541406 run create_hlr_db(pid=9270): Launched 12:45:04.679376 bus /sierra_2: Setting Powered False 12:45:05.744932 run create_hlr_db(pid=9270): Terminated: ok {rc=0} 12:45:06.210620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9272): Launched 12:45:06.549102 run osmo-hlr_10.42.42.2(pid=9273): Launched 12:45:06.678438 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:07.258558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9275): Launched 12:45:07.598178 run osmo-stp_10.42.42.5(pid=9276): Launched 12:45:07.728122 run osmo-msc_10.42.42.6: Starting osmo-msc 12:45:08.338017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9278): Launched 12:45:08.677815 run osmo-msc_10.42.42.6(pid=9279): Launched 12:45:08.866426 run osmo-stp_10.42.42.5(pid=9276): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9276)] 12:45:09.007833 run osmo-stp_10.42.42.5(pid=9276): stdout: | (launched: 2022-12-10_12:45:07.535047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:09.149961 run osmo-stp_10.42.42.5(pid=9276): stderr: | [0;m[38;5;43m20221210124507731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124507731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124507731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124507731 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124507734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124507734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124507734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:09.290660 run osmo-stp_10.42.42.5(pid=9276): stdout: | (launched: 2022-12-10_12:45:07.535047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:09.424372 run osmo-stp_10.42.42.5(pid=9276): stderr: | [0;m[38;5;43m20221210124507731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124507731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124507731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124507731 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124507734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124507734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124507734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:09.583932 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9276): Process ended prematurely: osmo-stp_10.42.42.5(pid=9276) [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9276)] [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:45:09.593546 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:45:09.621679 run osmo-hlr_10.42.42.2(pid=9273): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9273)] 12:45:09.673092 run osmo-hlr_10.42.42.2(pid=9273): stdout: | (launched: 2022-12-10_12:45:06.486365) 12:45:09.726231 run osmo-hlr_10.42.42.2(pid=9273): stderr: | [0;m[1;31m20221210124506690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124506690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124506690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124506690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124506690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124506690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124506702 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124506711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124506711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124506712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:09.800044 run osmo-msc_10.42.42.6(pid=9279): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9279)] 12:45:09.851477 run osmo-msc_10.42.42.6(pid=9279): stdout: | (launched: 2022-12-10_12:45:08.614748) 12:45:09.904486 run osmo-msc_10.42.42.6(pid=9279): stderr: | [0;m[38;5;43m20221210124508944 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124508944 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faa24141c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124508944 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124508944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124508944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124508945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124508946 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124508947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124508947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124508947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:45:09.957625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9272): Terminating (SIGTERM) 12:45:10.000167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9275): Terminating (SIGTERM) 12:45:10.042815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9278): Terminating (SIGTERM) 12:45:10.085814 --- ParallelTerminationStrategy: PID 9272 died... 12:45:10.106171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9272): Terminated: ok {rc=0} 12:45:10.153233 --- ParallelTerminationStrategy: PID 9275 died... 12:45:10.173123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9275): Terminated: ok {rc=0} 12:45:10.219961 --- ParallelTerminationStrategy: PID 9278 died... 12:45:10.239778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9278): Terminated: ok {rc=0} 12:45:10.329336 bus /sierra_3: Setting Powered False 12:45:11.429979 bus /sierra_3: Setting Powered False 12:45:12.546582 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:45:13.780089 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:45:13.786527 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:45:13.807814 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:45:13.834490 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:45:13.886923 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:45:13.907735 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:45:13.934300 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:45:14.486899 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:45:14.537409 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:45:14.548273 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:45:14.606733 tst mo_mt_call.py: using LAC 28485 12:45:14.730525 tst mo_mt_call.py: using RAC 180 12:45:14.855101 tst mo_mt_call.py: using CellId 28485 12:45:14.979197 tst mo_mt_call.py: using BVCI 28486 12:45:15.095716 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:45:15.106845 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:45:15.117803 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:45:15.128697 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:45:15.139839 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:45:15.150956 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:45:15.266875 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:45:15.384654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:15.905898 run create_hlr_db(pid=9284): Launched 12:45:16.077426 bus /sierra_2: Setting Powered False 12:45:17.139444 run create_hlr_db(pid=9284): Terminated: ok {rc=0} 12:45:17.596067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9286): Launched 12:45:17.915035 run osmo-hlr_10.42.42.2(pid=9287): Launched 12:45:18.037570 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:18.581703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9289): Launched 12:45:18.900181 run osmo-stp_10.42.42.5(pid=9290): Launched 12:45:19.022493 run osmo-msc_10.42.42.6: Starting osmo-msc 12:45:19.594309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9292): Launched 12:45:19.912794 run osmo-msc_10.42.42.6(pid=9293): Launched 12:45:20.090100 run osmo-stp_10.42.42.5(pid=9290): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9290)] 12:45:20.224018 run osmo-stp_10.42.42.5(pid=9290): stdout: | (launched: 2022-12-10_12:45:18.840427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:20.357071 run osmo-stp_10.42.42.5(pid=9290): stderr: | [0;m[38;5;43m20221210124519015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124519015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124519015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124519016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124519018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124519018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124519018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:20.488087 run osmo-stp_10.42.42.5(pid=9290): stdout: | (launched: 2022-12-10_12:45:18.840427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:20.612909 run osmo-stp_10.42.42.5(pid=9290): stderr: | [0;m[38;5;43m20221210124519015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124519015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124519015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124519016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124519018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124519018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124519018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:20.762544 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9290): Process ended prematurely: osmo-stp_10.42.42.5(pid=9290) [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9290)] [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:45:20.771346 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:45:20.798518 run osmo-hlr_10.42.42.2(pid=9287): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9287)] 12:45:20.847572 run osmo-hlr_10.42.42.2(pid=9287): stdout: | (launched: 2022-12-10_12:45:17.855556) 12:45:20.898135 run osmo-hlr_10.42.42.2(pid=9287): stderr: | [0;m[1;31m20221210124518034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124518034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124518034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124518034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124518034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124518034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124518046 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124518054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124518055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124518055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:20.968380 run osmo-msc_10.42.42.6(pid=9293): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9293)] 12:45:21.017258 run osmo-msc_10.42.42.6(pid=9293): stdout: | (launched: 2022-12-10_12:45:19.853598) 12:45:21.067527 run osmo-msc_10.42.42.6(pid=9293): stderr: | [0;m[38;5;43m20221210124520128 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124520129 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff063a14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124520129 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124520129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124520129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124520129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124520131 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124520131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124520131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124520132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:45:21.118253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9286): Terminating (SIGTERM) 12:45:21.158287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9289): Terminating (SIGTERM) 12:45:21.198922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9292): Terminating (SIGTERM) 12:45:21.239541 --- ParallelTerminationStrategy: PID 9286 died... 12:45:21.258678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9286): Terminated: ok {rc=0} 12:45:21.303164 --- ParallelTerminationStrategy: PID 9289 died... 12:45:21.321903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9289): Terminated: ok {rc=0} 12:45:21.366195 --- ParallelTerminationStrategy: PID 9292 died... 12:45:21.384792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9292): Terminated: ok {rc=0} 12:45:21.471972 bus /sierra_3: Setting Powered False 12:45:22.572192 bus /sierra_3: Setting Powered False 12:45:23.689256 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:45:24.840001 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:45:24.851771 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:45:24.907680 tst mo_mt_call_osmux.py: using LAC 28486 12:45:25.033302 tst mo_mt_call_osmux.py: using RAC 181 12:45:25.158333 tst mo_mt_call_osmux.py: using CellId 28486 12:45:25.285258 tst mo_mt_call_osmux.py: using BVCI 28487 12:45:25.402024 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:45:25.413163 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:45:25.423897 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:45:25.434939 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:45:25.446129 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:45:25.457289 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:45:25.579199 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:45:25.697443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:26.188608 run create_hlr_db(pid=9295): Launched 12:45:26.310770 bus /sierra_2: Setting Powered False 12:45:27.373365 run create_hlr_db(pid=9295): Terminated: ok {rc=0} 12:45:27.832817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9297): Launched 12:45:28.171685 run osmo-hlr_10.42.42.2(pid=9298): Launched 12:45:28.302135 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:28.883268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9300): Launched 12:45:29.220308 run osmo-stp_10.42.42.5(pid=9301): Launched 12:45:29.352576 run osmo-msc_10.42.42.6: Starting osmo-msc 12:45:29.961566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9303): Launched 12:45:30.299748 run osmo-msc_10.42.42.6(pid=9304): Launched 12:45:30.489764 run osmo-stp_10.42.42.5(pid=9301): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9301)] 12:45:30.631118 run osmo-stp_10.42.42.5(pid=9301): stdout: | (launched: 2022-12-10_12:45:29.157684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:30.772225 run osmo-stp_10.42.42.5(pid=9301): stderr: | [0;m[38;5;43m20221210124529353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124529353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124529353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124529354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124529354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124529354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124529354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:30.932636 run osmo-stp_10.42.42.5(pid=9301): stdout: | (launched: 2022-12-10_12:45:29.157684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:31.084080 run osmo-stp_10.42.42.5(pid=9301): stderr: | [0;m[38;5;43m20221210124529353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124529353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124529353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124529354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124529354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124529354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124529354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:31.245514 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9301): Process ended prematurely: osmo-stp_10.42.42.5(pid=9301) [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9301)] [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:45:31.255918 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:45:31.285071 run osmo-hlr_10.42.42.2(pid=9298): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9298)] 12:45:31.337464 run osmo-hlr_10.42.42.2(pid=9298): stdout: | (launched: 2022-12-10_12:45:28.108806) 12:45:31.391266 run osmo-hlr_10.42.42.2(pid=9298): stderr: | [0;m[1;31m20221210124528311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124528311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124528311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124528311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124528311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124528311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124528323 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124528334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124528334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124528334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:31.465651 run osmo-msc_10.42.42.6(pid=9304): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9304)] 12:45:31.517062 run osmo-msc_10.42.42.6(pid=9304): stdout: | (launched: 2022-12-10_12:45:30.236655) 12:45:31.570029 run osmo-msc_10.42.42.6(pid=9304): stderr: | [0;m[38;5;43m20221210124530562 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124530563 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8ef3988c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124530563 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124530563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124530563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124530563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124530565 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124530565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124530565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124530566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:45:31.624104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9297): Terminating (SIGTERM) 12:45:31.667391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9300): Terminating (SIGTERM) 12:45:31.711634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9303): Terminating (SIGTERM) 12:45:31.755280 --- ParallelTerminationStrategy: PID 9297 died... 12:45:31.775665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9297): Terminated: ok {rc=0} 12:45:31.824008 --- ParallelTerminationStrategy: PID 9300 died... 12:45:31.844268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9300): Terminated: ok {rc=0} 12:45:31.891366 --- ParallelTerminationStrategy: PID 9303 died... 12:45:31.911511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9303): Terminated: ok {rc=0} 12:45:32.007774 bus /sierra_3: Setting Powered False 12:45:33.120179 bus /sierra_3: Setting Powered False 12:45:34.235941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:45:35.472243 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:45:35.478624 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:45:35.499447 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:45:35.526580 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:45:35.579680 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:45:35.601090 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:45:35.627264 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:45:36.174917 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:45:36.226000 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:45:36.237099 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:45:36.292690 tst mo_mt_call.py: using LAC 28487 12:45:36.418684 tst mo_mt_call.py: using RAC 182 12:45:36.544559 tst mo_mt_call.py: using CellId 28487 12:45:36.671501 tst mo_mt_call.py: using BVCI 28488 12:45:36.786915 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:45:36.798110 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:45:36.809426 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:45:36.820325 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:45:36.831373 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:45:36.842574 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:45:36.964498 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:45:37.083981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:37.610167 run create_hlr_db(pid=9309): Launched 12:45:37.749086 bus /sierra_2: Setting Powered False 12:45:38.814991 run create_hlr_db(pid=9309): Terminated: ok {rc=0} 12:45:39.280487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9311): Launched 12:45:39.618624 run osmo-hlr_10.42.42.2(pid=9312): Launched 12:45:39.746293 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:40.329440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9314): Launched 12:45:40.667119 run osmo-stp_10.42.42.5(pid=9315): Launched 12:45:40.794879 run osmo-msc_10.42.42.6: Starting osmo-msc 12:45:41.404942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9317): Launched 12:45:41.743827 run osmo-msc_10.42.42.6(pid=9318): Launched 12:45:41.932043 run osmo-stp_10.42.42.5(pid=9315): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9315)] 12:45:42.073223 run osmo-stp_10.42.42.5(pid=9315): stdout: | (launched: 2022-12-10_12:45:40.604249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:42.215080 run osmo-stp_10.42.42.5(pid=9315): stderr: | [0;m[38;5;43m20221210124540800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124540800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124540800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124540801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124540801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124540801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124540801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:42.356189 run osmo-stp_10.42.42.5(pid=9315): stdout: | (launched: 2022-12-10_12:45:40.604249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:42.489530 run osmo-stp_10.42.42.5(pid=9315): stderr: | [0;m[38;5;43m20221210124540800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124540800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124540800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124540801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124540801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124540801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124540801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:42.649444 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9315): Process ended prematurely: osmo-stp_10.42.42.5(pid=9315) [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9315)] [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:45:42.659109 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:45:42.687188 run osmo-hlr_10.42.42.2(pid=9312): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9312)] 12:45:42.737887 run osmo-hlr_10.42.42.2(pid=9312): stdout: | (launched: 2022-12-10_12:45:39.555705) 12:45:42.790167 run osmo-hlr_10.42.42.2(pid=9312): stderr: | [0;m[1;31m20221210124539760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124539760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124539760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124539760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124539760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124539761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124539773 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124539781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124539782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124539782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:42.863926 run osmo-msc_10.42.42.6(pid=9318): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9318)] 12:45:42.914489 run osmo-msc_10.42.42.6(pid=9318): stdout: | (launched: 2022-12-10_12:45:41.680665) 12:45:42.966607 run osmo-msc_10.42.42.6(pid=9318): stderr: | [0;m[38;5;43m20221210124542008 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124542009 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f758d60ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124542009 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124542009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124542009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124542009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124542011 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124542011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124542011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124542011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:45:43.019042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9311): Terminating (SIGTERM) 12:45:43.061041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9314): Terminating (SIGTERM) 12:45:43.103329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9317): Terminating (SIGTERM) 12:45:43.145553 --- ParallelTerminationStrategy: PID 9311 died... 12:45:43.165658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9311): Terminated: ok {rc=0} 12:45:43.212296 --- ParallelTerminationStrategy: PID 9314 died... 12:45:43.232091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9314): Terminated: ok {rc=0} 12:45:43.278707 --- ParallelTerminationStrategy: PID 9317 died... 12:45:43.298599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9317): Terminated: ok {rc=0} 12:45:43.387809 bus /sierra_3: Setting Powered False 12:45:44.488905 bus /sierra_3: Setting Powered False 12:45:45.610126 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:45:46.757877 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:45:46.770600 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:45:46.829791 tst mo_mt_call_osmux.py: using LAC 28488 12:45:46.992830 tst mo_mt_call_osmux.py: using RAC 183 12:45:47.120316 tst mo_mt_call_osmux.py: using CellId 28488 12:45:47.264863 tst mo_mt_call_osmux.py: using BVCI 28489 12:45:47.388719 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:45:47.400006 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:45:47.411003 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:45:47.422484 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:45:47.433819 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:45:47.445203 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:45:47.566879 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:45:47.687719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:48.213692 run create_hlr_db(pid=9320): Launched 12:45:48.352219 bus /sierra_2: Setting Powered False 12:45:49.418098 run create_hlr_db(pid=9320): Terminated: ok {rc=0} 12:45:49.885085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9322): Launched 12:45:50.224032 run osmo-hlr_10.42.42.2(pid=9323): Launched 12:45:50.354183 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:50.933947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9325): Launched 12:45:51.270702 run osmo-stp_10.42.42.5(pid=9326): Launched 12:45:51.399574 run osmo-msc_10.42.42.6: Starting osmo-msc 12:45:52.009431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9328): Launched 12:45:52.351906 run osmo-msc_10.42.42.6(pid=9329): Launched 12:45:52.541648 run osmo-stp_10.42.42.5(pid=9326): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9326)] 12:45:52.683168 run osmo-stp_10.42.42.5(pid=9326): stdout: | (launched: 2022-12-10_12:45:51.207730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:52.824770 run osmo-stp_10.42.42.5(pid=9326): stderr: | [0;m[38;5;43m20221210124551407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124551408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124551408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124551408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124551409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124551409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124551409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:52.965648 run osmo-stp_10.42.42.5(pid=9326): stdout: | (launched: 2022-12-10_12:45:51.207730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:53.099514 run osmo-stp_10.42.42.5(pid=9326): stderr: | [0;m[38;5;43m20221210124551407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124551408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124551408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124551408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124551409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124551409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124551409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:53.259667 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9326): Process ended prematurely: osmo-stp_10.42.42.5(pid=9326) [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9326)] [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:45:53.269516 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 12:45:53.297817 run osmo-hlr_10.42.42.2(pid=9323): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9323)] 12:45:53.349440 run osmo-hlr_10.42.42.2(pid=9323): stdout: | (launched: 2022-12-10_12:45:50.161311) 12:45:53.402317 run osmo-hlr_10.42.42.2(pid=9323): stderr: | [0;m[1;31m20221210124550367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124550367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124550367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124550368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124550368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124550368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124550380 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124550389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124550389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124550389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:53.476108 run osmo-msc_10.42.42.6(pid=9329): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9329)] 12:45:53.527836 run osmo-msc_10.42.42.6(pid=9329): stdout: | (launched: 2022-12-10_12:45:52.287503) 12:45:53.580691 run osmo-msc_10.42.42.6(pid=9329): stderr: | [0;m[38;5;43m20221210124552615 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124552615 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f00a3e4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124552615 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124552615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124552616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124552616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124552617 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124552618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124552618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124552618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:45:53.633680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9322): Terminating (SIGTERM) 12:45:53.676424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9325): Terminating (SIGTERM) 12:45:53.719401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9328): Terminating (SIGTERM) 12:45:53.762130 --- ParallelTerminationStrategy: PID 9322 died... 12:45:53.782586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9322): Terminated: ok {rc=0} 12:45:53.829748 --- ParallelTerminationStrategy: PID 9325 died... 12:45:53.849709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9325): Terminated: ok {rc=0} 12:45:53.896344 --- ParallelTerminationStrategy: PID 9328 died... 12:45:53.916131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9328): Terminated: ok {rc=0} 12:45:54.004672 bus /sierra_3: Setting Powered False 12:45:55.105891 bus /sierra_3: Setting Powered False 12:45:56.222979 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:45:57.465876 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:45:57.472814 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:45:57.494579 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:45:57.521840 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:45:57.574999 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:45:57.596098 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:45:57.623030 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:45:58.175136 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:45:58.228401 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:45:58.240076 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:45:58.297591 tst mo_mt_call.py: using LAC 28489 12:45:58.432131 tst mo_mt_call.py: using RAC 184 12:45:58.564694 tst mo_mt_call.py: using CellId 28489 12:45:58.695887 tst mo_mt_call.py: using BVCI 28490 12:45:58.818151 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:45:58.829671 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:45:58.840775 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:45:58.852128 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:45:58.863380 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:45:58.874692 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:45:58.991978 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:45:59.110611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:59.599614 run create_hlr_db(pid=9335): Launched 12:45:59.721264 bus /sierra_2: Setting Powered False 12:46:00.783992 run create_hlr_db(pid=9335): Terminated: ok {rc=0} 12:46:01.275668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9337): Launched 12:46:01.609927 run osmo-hlr_10.42.42.2(pid=9338): Launched 12:46:01.792920 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:02.470848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9340): Launched 12:46:02.788815 run osmo-stp_10.42.42.5(pid=9341): Launched 12:46:02.911763 run osmo-msc_10.42.42.6: Starting osmo-msc 12:46:03.481601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9343): Launched 12:46:03.801303 run osmo-msc_10.42.42.6(pid=9344): Launched 12:46:03.979032 run osmo-stp_10.42.42.5(pid=9341): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9341)] 12:46:04.112213 run osmo-stp_10.42.42.5(pid=9341): stdout: | (launched: 2022-12-10_12:46:02.729711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:04.244634 run osmo-stp_10.42.42.5(pid=9341): stderr: | [0;m[38;5;43m20221210124602905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124602905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124602905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124602906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124602906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124602906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124602906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:04.375793 run osmo-stp_10.42.42.5(pid=9341): stdout: | (launched: 2022-12-10_12:46:02.729711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:04.500862 run osmo-stp_10.42.42.5(pid=9341): stderr: | [0;m[38;5;43m20221210124602905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124602905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124602905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124602906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124602906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124602906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124602906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:04.650267 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9341): Process ended prematurely: osmo-stp_10.42.42.5(pid=9341) [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9341)] [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:46:04.659288 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:46:04.686364 run osmo-hlr_10.42.42.2(pid=9338): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9338)] 12:46:04.734809 run osmo-hlr_10.42.42.2(pid=9338): stdout: | (launched: 2022-12-10_12:46:01.549090) 12:46:04.784789 run osmo-hlr_10.42.42.2(pid=9338): stderr: | [0;m[1;31m20221210124601921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124601921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124601921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124601921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124601921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124601922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124601935 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124601951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124601951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124601951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:04.854476 run osmo-msc_10.42.42.6(pid=9344): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9344)] 12:46:04.902650 run osmo-msc_10.42.42.6(pid=9344): stdout: | (launched: 2022-12-10_12:46:03.741569) 12:46:04.952485 run osmo-msc_10.42.42.6(pid=9344): stderr: | [0;m[38;5;43m20221210124604017 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124604017 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f539e50dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124604017 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124604017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124604017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124604017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124604019 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124604020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124604020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124604020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:46:05.002946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9337): Terminating (SIGTERM) 12:46:05.043148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9340): Terminating (SIGTERM) 12:46:05.083219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9343): Terminating (SIGTERM) 12:46:05.123509 --- ParallelTerminationStrategy: PID 9337 died... 12:46:05.142534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9337): Terminated: ok {rc=0} 12:46:05.186970 --- ParallelTerminationStrategy: PID 9340 died... 12:46:05.205606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9340): Terminated: ok {rc=0} 12:46:05.249933 --- ParallelTerminationStrategy: PID 9343 died... 12:46:05.268532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9343): Terminated: ok {rc=0} 12:46:05.351939 bus /sierra_3: Setting Powered False 12:46:06.451112 bus /sierra_3: Setting Powered False 12:46:07.568856 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:46:08.717882 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:46:08.729777 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:46:08.785430 tst mo_mt_call_osmux.py: using LAC 28490 12:46:08.915545 tst mo_mt_call_osmux.py: using RAC 185 12:46:09.039422 tst mo_mt_call_osmux.py: using CellId 28490 12:46:09.162101 tst mo_mt_call_osmux.py: using BVCI 28491 12:46:09.279669 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:46:09.290898 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:46:09.301856 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:46:09.312821 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:46:09.323999 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:46:09.335435 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:46:09.452336 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:46:09.575211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:10.101681 run create_hlr_db(pid=9346): Launched 12:46:10.240538 bus /sierra_2: Setting Powered False 12:46:11.306663 run create_hlr_db(pid=9346): Terminated: ok {rc=0} 12:46:11.758119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9348): Launched 12:46:12.075702 run osmo-hlr_10.42.42.2(pid=9349): Launched 12:46:12.197846 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:12.746180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9351): Launched 12:46:13.065500 run osmo-stp_10.42.42.5(pid=9352): Launched 12:46:13.188174 run osmo-msc_10.42.42.6: Starting osmo-msc 12:46:13.762624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9354): Launched 12:46:14.081616 run osmo-msc_10.42.42.6(pid=9355): Launched 12:46:14.258972 run osmo-stp_10.42.42.5(pid=9352): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9352)] 12:46:14.393421 run osmo-stp_10.42.42.5(pid=9352): stdout: | (launched: 2022-12-10_12:46:13.006159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:14.527068 run osmo-stp_10.42.42.5(pid=9352): stderr: | [0;m[38;5;43m20221210124613182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124613182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124613182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124613182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124613183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124613183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124613183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:14.658935 run osmo-stp_10.42.42.5(pid=9352): stdout: | (launched: 2022-12-10_12:46:13.006159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:14.784863 run osmo-stp_10.42.42.5(pid=9352): stderr: | [0;m[38;5;43m20221210124613182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124613182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124613182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124613182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124613183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124613183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124613183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:14.936241 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9352): Process ended prematurely: osmo-stp_10.42.42.5(pid=9352) [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9352)] [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:46:14.945461 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:46:14.972501 run osmo-hlr_10.42.42.2(pid=9349): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9349)] 12:46:15.021656 run osmo-hlr_10.42.42.2(pid=9349): stdout: | (launched: 2022-12-10_12:46:12.016162) 12:46:15.072333 run osmo-hlr_10.42.42.2(pid=9349): stderr: | [0;m[1;31m20221210124612198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124612198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124612198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124612198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124612198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124612198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124612210 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124612218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124612219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124612219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:15.142504 run osmo-msc_10.42.42.6(pid=9355): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9355)] 12:46:15.191347 run osmo-msc_10.42.42.6(pid=9355): stdout: | (launched: 2022-12-10_12:46:14.022233) 12:46:15.241906 run osmo-msc_10.42.42.6(pid=9355): stderr: | [0;m[38;5;43m20221210124614298 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124614298 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7570d64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124614298 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124614298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124614298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124614299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124614300 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124614301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124614301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124614301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:46:15.292463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9348): Terminating (SIGTERM) 12:46:15.332804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9351): Terminating (SIGTERM) 12:46:15.373613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9354): Terminating (SIGTERM) 12:46:15.414223 --- ParallelTerminationStrategy: PID 9348 died... 12:46:15.433481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9348): Terminated: ok {rc=0} 12:46:15.478471 --- ParallelTerminationStrategy: PID 9351 died... 12:46:15.497457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9351): Terminated: ok {rc=0} 12:46:15.542200 --- ParallelTerminationStrategy: PID 9354 died... 12:46:15.561119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9354): Terminated: ok {rc=0} 12:46:15.648459 bus /sierra_3: Setting Powered False 12:46:16.755239 bus /sierra_3: Setting Powered False 12:46:17.881172 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:46:19.122612 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:46:19.130170 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:46:19.151165 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:46:19.178023 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:46:19.233733 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:46:19.255017 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:46:19.281881 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:46:19.826723 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:46:19.877986 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:46:19.888849 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:46:19.943373 tst mo_mt_call.py: using LAC 28491 12:46:20.067904 tst mo_mt_call.py: using RAC 186 12:46:20.190603 tst mo_mt_call.py: using CellId 28491 12:46:20.312646 tst mo_mt_call.py: using BVCI 28492 12:46:20.428021 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:46:20.439154 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:46:20.450022 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:46:20.461164 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:46:20.472131 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:46:20.483480 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:46:20.604372 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:46:20.723500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:21.216943 run create_hlr_db(pid=9360): Launched 12:46:21.337992 bus /sierra_2: Setting Powered False 12:46:22.399307 run create_hlr_db(pid=9360): Terminated: ok {rc=0} 12:46:22.859031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9362): Launched 12:46:23.196543 run osmo-hlr_10.42.42.2(pid=9363): Launched 12:46:23.327037 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:23.909913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9365): Launched 12:46:24.248388 run osmo-stp_10.42.42.5(pid=9366): Launched 12:46:24.379272 run osmo-msc_10.42.42.6: Starting osmo-msc 12:46:24.987943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9368): Launched 12:46:25.326156 run osmo-msc_10.42.42.6(pid=9369): Launched 12:46:25.516152 run osmo-stp_10.42.42.5(pid=9366): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9366)] 12:46:25.657955 run osmo-stp_10.42.42.5(pid=9366): stdout: | (launched: 2022-12-10_12:46:24.185488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:25.800706 run osmo-stp_10.42.42.5(pid=9366): stderr: | [0;m[38;5;43m20221210124624384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124624384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124624385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124624385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124624386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124624386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124624386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:25.940728 run osmo-stp_10.42.42.5(pid=9366): stdout: | (launched: 2022-12-10_12:46:24.185488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:26.074074 run osmo-stp_10.42.42.5(pid=9366): stderr: | [0;m[38;5;43m20221210124624384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124624384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124624385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124624385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124624386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124624386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124624386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:26.233928 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9366): Process ended prematurely: osmo-stp_10.42.42.5(pid=9366) [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9366)] [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:46:26.243433 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:46:26.271555 run osmo-hlr_10.42.42.2(pid=9363): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9363)] 12:46:26.322324 run osmo-hlr_10.42.42.2(pid=9363): stdout: | (launched: 2022-12-10_12:46:23.133758) 12:46:26.375376 run osmo-hlr_10.42.42.2(pid=9363): stderr: | [0;m[1;31m20221210124623336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124623336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124623336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124623336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124623336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124623336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124623349 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124623358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124623358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124623358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:26.448468 run osmo-msc_10.42.42.6(pid=9369): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9369)] 12:46:26.499353 run osmo-msc_10.42.42.6(pid=9369): stdout: | (launched: 2022-12-10_12:46:25.262754) 12:46:26.551883 run osmo-msc_10.42.42.6(pid=9369): stderr: | [0;m[38;5;43m20221210124625592 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124625592 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90ee34dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124625592 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124625592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124625592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124625592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124625594 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124625594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124625595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124625595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:46:26.604835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9362): Terminating (SIGTERM) 12:46:26.647531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9365): Terminating (SIGTERM) 12:46:26.690234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9368): Terminating (SIGTERM) 12:46:26.733181 --- ParallelTerminationStrategy: PID 9362 died... 12:46:26.753347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9362): Terminated: ok {rc=0} 12:46:26.799954 --- ParallelTerminationStrategy: PID 9365 died... 12:46:26.819579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9365): Terminated: ok {rc=0} 12:46:26.866003 --- ParallelTerminationStrategy: PID 9368 died... 12:46:26.885719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9368): Terminated: ok {rc=0} 12:46:26.973895 bus /sierra_3: Setting Powered False 12:46:28.074731 bus /sierra_3: Setting Powered False 12:46:29.193948 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:46:30.342604 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:46:30.354781 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:46:30.418897 tst mo_mt_call_osmux.py: using LAC 28492 12:46:30.553871 tst mo_mt_call_osmux.py: using RAC 187 12:46:30.689557 tst mo_mt_call_osmux.py: using CellId 28492 12:46:30.819923 tst mo_mt_call_osmux.py: using BVCI 28493 12:46:30.961719 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:46:30.973724 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:46:30.986858 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:46:30.999754 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:46:31.011706 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:46:31.024850 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:46:31.148447 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:46:31.301327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:31.867872 run create_hlr_db(pid=9371): Launched 12:46:32.039469 bus /sierra_2: Setting Powered False 12:46:33.105586 run create_hlr_db(pid=9371): Terminated: ok {rc=0} 12:46:33.571819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9373): Launched 12:46:33.909981 run osmo-hlr_10.42.42.2(pid=9374): Launched 12:46:34.037698 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:34.619226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9376): Launched 12:46:34.954955 run osmo-stp_10.42.42.5(pid=9377): Launched 12:46:35.082609 run osmo-msc_10.42.42.6: Starting osmo-msc 12:46:35.689926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9379): Launched 12:46:36.028758 run osmo-msc_10.42.42.6(pid=9380): Launched 12:46:36.214664 run osmo-stp_10.42.42.5(pid=9377): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9377)] 12:46:36.356018 run osmo-stp_10.42.42.5(pid=9377): stdout: | (launched: 2022-12-10_12:46:34.892403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:36.497269 run osmo-stp_10.42.42.5(pid=9377): stderr: | [0;m[38;5;43m20221210124635089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124635089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124635089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124635090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124635090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124635090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124635090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:36.636454 run osmo-stp_10.42.42.5(pid=9377): stdout: | (launched: 2022-12-10_12:46:34.892403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:36.769739 run osmo-stp_10.42.42.5(pid=9377): stderr: | [0;m[38;5;43m20221210124635089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124635089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124635089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124635090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124635090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124635090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124635090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:36.928865 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9377): Process ended prematurely: osmo-stp_10.42.42.5(pid=9377) [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9377)] [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:46:36.938418 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 12:46:36.966156 run osmo-hlr_10.42.42.2(pid=9374): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9374)] 12:46:37.016415 run osmo-hlr_10.42.42.2(pid=9374): stdout: | (launched: 2022-12-10_12:46:33.847239) 12:46:37.068156 run osmo-hlr_10.42.42.2(pid=9374): stderr: | [0;m[1;31m20221210124634050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124634050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124634050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124634050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124634050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124634050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124634061 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124634070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124634070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124634070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:37.140460 run osmo-msc_10.42.42.6(pid=9380): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9380)] 12:46:37.190875 run osmo-msc_10.42.42.6(pid=9380): stdout: | (launched: 2022-12-10_12:46:35.966131) 12:46:37.242841 run osmo-msc_10.42.42.6(pid=9380): stderr: | [0;m[38;5;43m20221210124636293 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124636294 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f56c1f46c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124636294 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124636294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124636294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124636294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124636296 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124636296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124636296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124636296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:46:37.295155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9373): Terminating (SIGTERM) 12:46:37.337495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9376): Terminating (SIGTERM) 12:46:37.379613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9379): Terminating (SIGTERM) 12:46:37.421727 --- ParallelTerminationStrategy: PID 9373 died... 12:46:37.441858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9373): Terminated: ok {rc=0} 12:46:37.488241 --- ParallelTerminationStrategy: PID 9376 died... 12:46:37.507816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9376): Terminated: ok {rc=0} 12:46:37.554179 --- ParallelTerminationStrategy: PID 9379 died... 12:46:37.573621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9379): Terminated: ok {rc=0} 12:46:37.661939 bus /sierra_3: Setting Powered False 12:46:38.759679 bus /sierra_3: Setting Powered False 12:46:39.878554 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:46:41.117479 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:46:41.124576 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:46:41.146290 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:46:41.173464 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:46:41.226338 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:46:41.247549 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:46:41.274636 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:46:41.826789 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:46:41.880536 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:46:41.892473 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:46:41.950626 tst mo_mt_call.py: using LAC 28493 12:46:42.081840 tst mo_mt_call.py: using RAC 188 12:46:42.213159 tst mo_mt_call.py: using CellId 28493 12:46:42.344825 tst mo_mt_call.py: using BVCI 28494 12:46:42.467519 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:46:42.479083 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:46:42.490402 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:46:42.502275 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:46:42.513619 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:46:42.525001 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:46:42.641968 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:46:42.764169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:43.288112 run create_hlr_db(pid=9385): Launched 12:46:43.424729 bus /sierra_2: Setting Powered False 12:46:44.490561 run create_hlr_db(pid=9385): Terminated: ok {rc=0} 12:46:44.941823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9387): Launched 12:46:45.259463 run osmo-hlr_10.42.42.2(pid=9388): Launched 12:46:45.382609 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:45.975958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9390): Launched 12:46:46.312089 run osmo-stp_10.42.42.5(pid=9391): Launched 12:46:46.617783 run osmo-msc_10.42.42.6: Starting osmo-msc 12:46:47.197524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9393): Launched 12:46:47.530143 run osmo-msc_10.42.42.6(pid=9394): Launched 12:46:47.709700 run osmo-stp_10.42.42.5(pid=9391): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9391)] 12:46:47.843477 run osmo-stp_10.42.42.5(pid=9391): stdout: | (launched: 2022-12-10_12:46:46.251189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:47.977420 run osmo-stp_10.42.42.5(pid=9391): stderr: | [0;m[38;5;43m20221210124646476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124646478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124646478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124646480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124646482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124646482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124646482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:48.109845 run osmo-stp_10.42.42.5(pid=9391): stdout: | (launched: 2022-12-10_12:46:46.251189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:48.235564 run osmo-stp_10.42.42.5(pid=9391): stderr: | [0;m[38;5;43m20221210124646476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124646478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124646478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124646480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124646482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124646482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124646482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:48.385925 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9391): Process ended prematurely: osmo-stp_10.42.42.5(pid=9391) [trial-2375↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9391)] [trial-2375↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:46:48.395005 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:46:48.422241 run osmo-hlr_10.42.42.2(pid=9388): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9388)] 12:46:48.470596 run osmo-hlr_10.42.42.2(pid=9388): stdout: | (launched: 2022-12-10_12:46:45.199819) 12:46:48.520910 run osmo-hlr_10.42.42.2(pid=9388): stderr: | [0;m[1;31m20221210124645382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124645382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124645382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124645382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124645382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124645382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124645395 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124645405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124645406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124645406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:48.590817 run osmo-msc_10.42.42.6(pid=9394): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9394)] 12:46:48.639474 run osmo-msc_10.42.42.6(pid=9394): stdout: | (launched: 2022-12-10_12:46:47.470086) 12:46:48.689753 run osmo-msc_10.42.42.6(pid=9394): stderr: | [0;m[38;5;43m20221210124647747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124647747 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0f06d6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124647747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124647747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124647747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124647747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124647749 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124647750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124647750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124647750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:46:48.740555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9387): Terminating (SIGTERM) 12:46:48.781021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9390): Terminating (SIGTERM) 12:46:48.821440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9393): Terminating (SIGTERM) 12:46:48.861913 --- ParallelTerminationStrategy: PID 9387 died... 12:46:48.881274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9387): Terminated: ok {rc=0} 12:46:48.926161 --- ParallelTerminationStrategy: PID 9390 died... 12:46:48.944936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9390): Terminated: ok {rc=0} 12:46:48.991028 --- ParallelTerminationStrategy: PID 9393 died... 12:46:49.010087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9393): Terminated: ok {rc=0} 12:46:49.097578 bus /sierra_3: Setting Powered False 12:46:50.199563 bus /sierra_3: Setting Powered False 12:46:51.317619 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:46:52.469146 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:46:52.481101 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:46:52.538148 tst mo_mt_call_osmux.py: using LAC 28494 12:46:52.664485 tst mo_mt_call_osmux.py: using RAC 189 12:46:52.790387 tst mo_mt_call_osmux.py: using CellId 28494 12:46:52.916179 tst mo_mt_call_osmux.py: using BVCI 28495 12:46:53.033067 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:46:53.044081 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:46:53.055132 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:46:53.066323 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:46:53.077591 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:46:53.088744 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:46:53.209931 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:46:53.330261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:53.822773 run create_hlr_db(pid=9396): Launched 12:46:53.944484 bus /sierra_2: Setting Powered False 12:46:55.006902 run create_hlr_db(pid=9396): Terminated: ok {rc=0} 12:46:55.468678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9398): Launched 12:46:55.787552 run osmo-hlr_10.42.42.2(pid=9399): Launched 12:46:55.910627 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:56.454412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9401): Launched 12:46:56.772534 run osmo-stp_10.42.42.5(pid=9402): Launched 12:46:56.894335 run osmo-msc_10.42.42.6: Starting osmo-msc 12:46:57.463104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9404): Launched 12:46:57.780526 run osmo-msc_10.42.42.6(pid=9405): Launched 12:46:57.958431 run osmo-stp_10.42.42.5(pid=9402): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9402)] 12:46:58.093635 run osmo-stp_10.42.42.5(pid=9402): stdout: | (launched: 2022-12-10_12:46:56.713142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:58.226866 run osmo-stp_10.42.42.5(pid=9402): stderr: | [0;m[38;5;43m20221210124656887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124656887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124656887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124656888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124656890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124656890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124656890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:58.358230 run osmo-stp_10.42.42.5(pid=9402): stdout: | (launched: 2022-12-10_12:46:56.713142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:58.483008 run osmo-stp_10.42.42.5(pid=9402): stderr: | [0;m[38;5;43m20221210124656887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124656887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124656887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124656888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124656890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124656890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124656890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:58.632771 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9402): Process ended prematurely: osmo-stp_10.42.42.5(pid=9402) [trial-2375↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9402)] [trial-2375↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:46:58.641742 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:46:58.668396 run osmo-hlr_10.42.42.2(pid=9399): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9399)] 12:46:58.716558 run osmo-hlr_10.42.42.2(pid=9399): stdout: | (launched: 2022-12-10_12:46:55.727762) 12:46:58.766099 run osmo-hlr_10.42.42.2(pid=9399): stderr: | [0;m[1;31m20221210124655910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124655910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124655910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124655910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124655910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124655910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124655923 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124655933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124655933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124655933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:58.835317 run osmo-msc_10.42.42.6(pid=9405): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9405)] 12:46:58.883350 run osmo-msc_10.42.42.6(pid=9405): stdout: | (launched: 2022-12-10_12:46:57.720914) 12:46:58.932839 run osmo-msc_10.42.42.6(pid=9405): stderr: | [0;m[38;5;43m20221210124657997 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124657997 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0c4cf1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124657998 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124657998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124657998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124657998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124658000 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124658000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124658000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124658000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:46:58.982736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9398): Terminating (SIGTERM) 12:46:59.022677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9401): Terminating (SIGTERM) 12:46:59.062719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9404): Terminating (SIGTERM) 12:46:59.103015 --- ParallelTerminationStrategy: PID 9398 died... 12:46:59.122290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9398): Terminated: ok {rc=0} 12:46:59.166677 --- ParallelTerminationStrategy: PID 9401 died... 12:46:59.185246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9401): Terminated: ok {rc=0} 12:46:59.229584 --- ParallelTerminationStrategy: PID 9404 died... 12:46:59.248145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9404): Terminated: ok {rc=0} 12:46:59.331450 bus /sierra_3: Setting Powered False 12:47:00.429759 bus /sierra_3: Setting Powered False 12:47:01.546773 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:47:02.797468 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:47:02.803473 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:47:02.824740 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:47:02.851914 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:47:02.905184 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:47:02.926360 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:47:02.953398 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:47:03.503277 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:47:03.556602 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:47:03.568248 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:47:03.626280 tst mo_mt_call.py: using LAC 28495 12:47:03.757560 tst mo_mt_call.py: using RAC 190 12:47:03.890330 tst mo_mt_call.py: using CellId 28495 12:47:04.026167 tst mo_mt_call.py: using BVCI 28496 12:47:04.149681 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:47:04.161046 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:47:04.172105 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:47:04.183169 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:47:04.194316 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:47:04.205466 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:47:04.328827 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:47:04.450736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:04.943290 run create_hlr_db(pid=9411): Launched 12:47:05.066683 bus /sierra_2: Setting Powered False 12:47:06.129439 run create_hlr_db(pid=9411): Terminated: ok {rc=0} 12:47:06.590311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9413): Launched 12:47:06.928874 run osmo-hlr_10.42.42.2(pid=9414): Launched 12:47:07.057924 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:07.644642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9416): Launched 12:47:07.983294 run osmo-stp_10.42.42.5(pid=9417): Launched 12:47:08.113311 run osmo-msc_10.42.42.6: Starting osmo-msc 12:47:08.724034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9419): Launched 12:47:09.062412 run osmo-msc_10.42.42.6(pid=9420): Launched 12:47:09.250165 run osmo-stp_10.42.42.5(pid=9417): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9417)] 12:47:09.392171 run osmo-stp_10.42.42.5(pid=9417): stdout: | (launched: 2022-12-10_12:47:07.920176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:09.534333 run osmo-stp_10.42.42.5(pid=9417): stderr: | [0;m[38;5;43m20221210124708118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124708118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124708118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124708118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124708121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124708121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124708121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:09.674787 run osmo-stp_10.42.42.5(pid=9417): stdout: | (launched: 2022-12-10_12:47:07.920176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:09.808617 run osmo-stp_10.42.42.5(pid=9417): stderr: | [0;m[38;5;43m20221210124708118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124708118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124708118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124708118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124708121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124708121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124708121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:09.969104 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9417): Process ended prematurely: osmo-stp_10.42.42.5(pid=9417) [trial-2375↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9417)] [trial-2375↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:47:09.978737 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:47:10.006658 run osmo-hlr_10.42.42.2(pid=9414): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9414)] 12:47:10.057559 run osmo-hlr_10.42.42.2(pid=9414): stdout: | (launched: 2022-12-10_12:47:06.866168) 12:47:10.110742 run osmo-hlr_10.42.42.2(pid=9414): stderr: | [0;m[1;31m20221210124707069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124707069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124707070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124707070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124707070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124707070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124707082 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124707091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124707091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124707091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:10.184093 run osmo-msc_10.42.42.6(pid=9420): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9420)] 12:47:10.235198 run osmo-msc_10.42.42.6(pid=9420): stdout: | (launched: 2022-12-10_12:47:08.999381) 12:47:10.287891 run osmo-msc_10.42.42.6(pid=9420): stderr: | [0;m[38;5;43m20221210124709326 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124709326 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f334a1f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124709326 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124709326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124709326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124709326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124709328 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124709328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124709329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124709329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:47:10.340890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9413): Terminating (SIGTERM) 12:47:10.383742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9416): Terminating (SIGTERM) 12:47:10.426492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9419): Terminating (SIGTERM) 12:47:10.469357 --- ParallelTerminationStrategy: PID 9413 died... 12:47:10.489623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9413): Terminated: ok {rc=0} 12:47:10.536449 --- ParallelTerminationStrategy: PID 9416 died... 12:47:10.556209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9416): Terminated: ok {rc=0} 12:47:10.603064 --- ParallelTerminationStrategy: PID 9419 died... 12:47:10.622777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9419): Terminated: ok {rc=0} 12:47:10.711781 bus /sierra_3: Setting Powered False 12:47:11.813869 bus /sierra_3: Setting Powered False 12:47:12.930783 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:47:14.082763 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:47:14.094871 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:47:14.154680 tst mo_mt_call_osmux.py: using LAC 28496 12:47:14.288086 tst mo_mt_call_osmux.py: using RAC 191 12:47:14.422070 tst mo_mt_call_osmux.py: using CellId 28496 12:47:14.556171 tst mo_mt_call_osmux.py: using BVCI 28497 12:47:14.680193 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:47:14.691705 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:47:14.702816 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:47:14.713960 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:47:14.725091 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:47:14.736234 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:47:14.860102 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:47:14.982418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:15.508368 run create_hlr_db(pid=9422): Launched 12:47:15.645936 bus /sierra_2: Setting Powered False 12:47:16.708935 run create_hlr_db(pid=9422): Terminated: ok {rc=0} 12:47:17.257302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9424): Launched 12:47:17.579022 run osmo-hlr_10.42.42.2(pid=9425): Launched 12:47:17.703147 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:18.260486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9427): Launched 12:47:18.581965 run osmo-stp_10.42.42.5(pid=9428): Launched 12:47:18.706558 run osmo-msc_10.42.42.6: Starting osmo-msc 12:47:19.282241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9430): Launched 12:47:19.600089 run osmo-msc_10.42.42.6(pid=9431): Launched 12:47:19.779090 run osmo-stp_10.42.42.5(pid=9428): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9428)] 12:47:19.913756 run osmo-stp_10.42.42.5(pid=9428): stdout: | (launched: 2022-12-10_12:47:18.522377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:20.047257 run osmo-stp_10.42.42.5(pid=9428): stderr: | [0;m[38;5;43m20221210124718697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124718697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124718697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124718698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124718698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124718698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124718698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:20.179151 run osmo-stp_10.42.42.5(pid=9428): stdout: | (launched: 2022-12-10_12:47:18.522377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:20.304809 run osmo-stp_10.42.42.5(pid=9428): stderr: | [0;m[38;5;43m20221210124718697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124718697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124718697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124718698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124718698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124718698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124718698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:20.455418 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9428): Process ended prematurely: osmo-stp_10.42.42.5(pid=9428) [trial-2375↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9428)] [trial-2375↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:47:20.464602 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:47:20.491880 run osmo-hlr_10.42.42.2(pid=9425): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9425)] 12:47:20.540558 run osmo-hlr_10.42.42.2(pid=9425): stdout: | (launched: 2022-12-10_12:47:17.519180) 12:47:20.590844 run osmo-hlr_10.42.42.2(pid=9425): stderr: | [0;m[1;31m20221210124717700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124717700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124717700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124717700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124717700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124717700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124717713 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124717721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124717721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124717721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:20.661035 run osmo-msc_10.42.42.6(pid=9431): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9431)] 12:47:20.709663 run osmo-msc_10.42.42.6(pid=9431): stdout: | (launched: 2022-12-10_12:47:19.540373) 12:47:20.759873 run osmo-msc_10.42.42.6(pid=9431): stderr: | [0;m[38;5;43m20221210124719818 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124719818 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd636c28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124719818 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124719818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124719818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124719819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124719820 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124719821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124719821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124719821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:47:20.810601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9424): Terminating (SIGTERM) 12:47:20.851128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9427): Terminating (SIGTERM) 12:47:20.891607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9430): Terminating (SIGTERM) 12:47:20.932585 --- ParallelTerminationStrategy: PID 9424 died... 12:47:20.951899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9424): Terminated: ok {rc=0} 12:47:20.996564 --- ParallelTerminationStrategy: PID 9427 died... 12:47:21.015400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9427): Terminated: ok {rc=0} 12:47:21.060248 --- ParallelTerminationStrategy: PID 9430 died... 12:47:21.079079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9430): Terminated: ok {rc=0} 12:47:21.164749 bus /sierra_3: Setting Powered False 12:47:22.264127 bus /sierra_3: Setting Powered False 12:47:23.381943 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 emergency:sysmo --------------------------------------------------------------------- 12:47:24.619880 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:47:24.624425 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 12:47:24.645556 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 12:47:24.673193 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 12:47:24.759441 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 12:47:24.780730 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 12:47:24.807744 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 12:47:25.392170 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2375 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 12:47:25.397400 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:47:25.408399 tst emergency:sysmo: Using 1 x bts (candidates: 1) 12:47:25.444826 tst emergency_mo_mt_call.py: using LAC 28497 12:47:25.573745 tst emergency_mo_mt_call.py: using RAC 192 12:47:25.701280 tst emergency_mo_mt_call.py: using CellId 28497 12:47:25.828879 tst emergency_mo_mt_call.py: using BVCI 28498 12:47:25.948220 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:47:25.959296 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:47:25.970229 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:47:25.981251 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:47:25.992141 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:47:26.003051 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:47:26.119634 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:47:26.241385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:26.726446 run create_hlr_db(pid=9436): Launched 12:47:26.847986 bus /sierra_2: Setting Powered False 12:47:27.908750 run create_hlr_db(pid=9436): Terminated: ok {rc=0} 12:47:28.344871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9438): Launched 12:47:28.659601 run osmo-hlr_10.42.42.2(pid=9439): Launched 12:47:28.780452 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:29.332433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9441): Launched 12:47:29.647506 run osmo-stp_10.42.42.5(pid=9442): Launched 12:47:29.778295 tst emergency_mo_mt_call.py: using MSISDN 7747 12:47:29.945241 run osmo-msc_10.42.42.6: Starting osmo-msc 12:47:30.503862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9444): Launched 12:47:30.817192 run osmo-msc_10.42.42.6(pid=9445): Launched 12:47:31.118295 run osmo-stp_10.42.42.5(pid=9442): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9442)] 12:47:31.270104 run osmo-stp_10.42.42.5(pid=9442): stdout: | (launched: 2022-12-10_12:47:29.588513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:31.481984 run osmo-stp_10.42.42.5(pid=9442): stderr: | [0;m[38;5;43m20221210124729763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124729763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124729763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124729764 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124729764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124729764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124729764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:31.641943 run osmo-stp_10.42.42.5(pid=9442): stdout: | (launched: 2022-12-10_12:47:29.588513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:31.769958 run osmo-stp_10.42.42.5(pid=9442): stderr: | [0;m[38;5;43m20221210124729763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124729763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124729763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124729764 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124729764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124729764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124729764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:31.922170 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9442): Process ended prematurely: osmo-stp_10.42.42.5(pid=9442) [trial-2375↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9442)] [trial-2375↪emergency:sysmo↪emergency_mo_mt_call.py:19] 12:47:31.931503 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 12:47:31.960351 run osmo-hlr_10.42.42.2(pid=9439): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9439)] 12:47:32.011459 run osmo-hlr_10.42.42.2(pid=9439): stdout: | (launched: 2022-12-10_12:47:28.600597) 12:47:32.064025 run osmo-hlr_10.42.42.2(pid=9439): stderr: | [0;m[1;31m20221210124728782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124728782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124728782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124728782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124728782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124728782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124728795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124728803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124728803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124728804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:32.136828 run osmo-msc_10.42.42.6(pid=9445): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9445)] 12:47:32.187792 run osmo-msc_10.42.42.6(pid=9445): stdout: | (launched: 2022-12-10_12:47:30.758288) 12:47:32.240213 run osmo-msc_10.42.42.6(pid=9445): stderr: | [0;m[38;5;43m20221210124731275 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124731275 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe21ff10c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124731275 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124731275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124731276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124731279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124731286 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124731287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124731287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124731287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:47:32.293877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9438): Terminating (SIGTERM) 12:47:32.336470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9441): Terminating (SIGTERM) 12:47:32.378996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9444): Terminating (SIGTERM) 12:47:32.421877 --- ParallelTerminationStrategy: PID 9438 died... 12:47:32.441789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9438): Terminated: ok {rc=0} 12:47:32.487138 --- ParallelTerminationStrategy: PID 9441 died... 12:47:32.506255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9441): Terminated: ok {rc=0} 12:47:32.551571 --- ParallelTerminationStrategy: PID 9444 died... 12:47:32.570657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9444): Terminated: ok {rc=0} 12:47:32.657953 bus /sierra_3: Setting Powered False 12:47:33.759463 bus /sierra_3: Setting Powered False 12:47:34.877579 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 12:47:35.967241 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:47:35.979593 tst emergency:sysmo: Using 1 x bts (candidates: 1) 12:47:36.018481 tst emergency_preemptive_call.py: using LAC 28498 12:47:36.145684 tst emergency_preemptive_call.py: using RAC 193 12:47:36.270661 tst emergency_preemptive_call.py: using CellId 28498 12:47:36.393772 tst emergency_preemptive_call.py: using BVCI 28499 12:47:36.515908 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:47:36.527239 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:47:36.538399 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:47:36.550122 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:47:36.563075 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:47:36.574456 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:47:36.692211 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:47:36.815255 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:47:36.938391 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:47:37.058593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:37.572782 run create_hlr_db(pid=9449): Launched 12:47:37.707972 bus /sierra_2: Setting Powered False 12:47:38.773679 run create_hlr_db(pid=9449): Terminated: ok {rc=0} 12:47:39.219000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9451): Launched 12:47:39.534480 run osmo-hlr_10.42.42.2(pid=9452): Launched 12:47:39.653461 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:40.205425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9454): Launched 12:47:40.522015 run osmo-stp_10.42.42.5(pid=9455): Launched 12:47:40.649745 tst emergency_preemptive_call.py: using MSISDN 7748 12:47:40.809416 run osmo-msc_10.42.42.6: Starting osmo-msc 12:47:41.366643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9457): Launched 12:47:41.678810 run osmo-msc_10.42.42.6(pid=9458): Launched 12:47:41.861276 run osmo-stp_10.42.42.5(pid=9455): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9455)] 12:47:41.994239 run osmo-stp_10.42.42.5(pid=9455): stdout: | (launched: 2022-12-10_12:47:40.462861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:42.125668 run osmo-stp_10.42.42.5(pid=9455): stderr: | [0;m[38;5;43m20221210124740638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124740638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124740638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124740639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124740639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124740639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124740639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:42.255114 run osmo-stp_10.42.42.5(pid=9455): stdout: | (launched: 2022-12-10_12:47:40.462861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:42.379271 run osmo-stp_10.42.42.5(pid=9455): stderr: | [0;m[38;5;43m20221210124740638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124740638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124740638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124740639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124740639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124740639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124740639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:42.527393 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9455): Process ended prematurely: osmo-stp_10.42.42.5(pid=9455) [trial-2375↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9455)] [trial-2375↪emergency:sysmo↪emergency_preemptive_call.py:32] 12:47:42.535798 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 12:47:42.562427 run osmo-hlr_10.42.42.2(pid=9452): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9452)] 12:47:42.611792 run osmo-hlr_10.42.42.2(pid=9452): stdout: | (launched: 2022-12-10_12:47:39.475319) 12:47:42.662481 run osmo-hlr_10.42.42.2(pid=9452): stderr: | [0;m[1;31m20221210124739656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124739656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124739656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124739656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124739656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124739656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124739668 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124739677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124739678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124739678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:42.733056 run osmo-msc_10.42.42.6(pid=9458): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9458)] 12:47:42.781747 run osmo-msc_10.42.42.6(pid=9458): stdout: | (launched: 2022-12-10_12:47:41.619662) 12:47:42.832339 run osmo-msc_10.42.42.6(pid=9458): stderr: | [0;m[38;5;43m20221210124741895 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210124741895 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe038542c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210124741895 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210124741895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210124741895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210124741895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210124741897 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210124741898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210124741898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210124741898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:47:42.883537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9451): Terminating (SIGTERM) 12:47:42.924304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9454): Terminating (SIGTERM) 12:47:42.965332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9457): Terminating (SIGTERM) 12:47:43.006342 --- ParallelTerminationStrategy: PID 9451 died... 12:47:43.025690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9451): Terminated: ok {rc=0} 12:47:43.070960 --- ParallelTerminationStrategy: PID 9454 died... 12:47:43.089879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9454): Terminated: ok {rc=0} 12:47:43.134855 --- ParallelTerminationStrategy: PID 9457 died... 12:47:43.153786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9457): Terminated: ok {rc=0} 12:47:43.240929 bus /sierra_9: Setting Powered False 12:47:44.339969 bus /sierra_9: Setting Powered False 12:47:45.454570 bus /sierra_8: Setting Powered False 12:47:46.555415 bus /sierra_8: Setting Powered False 12:47:47.679311 bus /sierra_3: Setting Powered False 12:47:48.778468 bus /sierra_3: Setting Powered False 12:47:49.895773 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:sysmo --------------------------------------------------------------------- 12:47:51.157661 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:47:51.161912 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 12:47:51.182515 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 12:47:51.221891 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 12:47:51.306987 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 12:47:51.327424 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 12:47:51.366306 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 12:47:51.955948 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 12:47:52.008484 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:47:52.019110 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:47:52.053041 tst cs_paging_gprs_active.py: using LAC 28499 12:47:52.190238 tst cs_paging_gprs_active.py: using RAC 194 12:47:52.321327 tst cs_paging_gprs_active.py: using CellId 28499 12:47:52.445609 tst cs_paging_gprs_active.py: using BVCI 28500 12:47:52.563396 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:47:52.574268 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:47:52.584690 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:47:52.595457 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:47:52.606216 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:47:52.616661 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:47:52.627351 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:47:52.637962 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:47:52.648582 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:47:52.765770 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:47:52.889931 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:47:53.119175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:47:53.460461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9464): Launched 12:47:53.756046 run iperf3-srv_10.42.42.10(pid=9465): Launched 12:47:53.883035 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:47:54.111051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:47:54.452430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9466): Launched 12:47:54.749334 run iperf3-srv_10.42.42.10(pid=9467): Launched 12:47:54.877493 tst cs_paging_gprs_active.py:38: start network... 12:47:55.106262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:55.634687 run create_hlr_db(pid=9468): Launched 12:47:55.772537 bus /sierra_2: Setting Powered False 12:47:56.837969 run create_hlr_db(pid=9468): Terminated: ok {rc=0} 12:47:57.308168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9470): Launched 12:47:57.649343 run osmo-hlr_10.42.42.2(pid=9471): Launched 12:47:57.779203 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:58.360327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9473): Launched 12:47:58.700490 run osmo-stp_10.42.42.5(pid=9474): Launched 12:47:58.831411 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:48:00.424429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9476): Launched 12:48:00.555946 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:48:00.849666 run patchelf(pid=9477): Launched 12:48:01.073089 run osmo-stp_10.42.42.5(pid=9474): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9474)] 12:48:01.213112 run osmo-stp_10.42.42.5(pid=9474): stdout: | (launched: 2022-12-10_12:47:58.637200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:01.355910 run osmo-stp_10.42.42.5(pid=9474): stderr: | [0;m[38;5;43m20221210124758835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124758835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124758835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124758836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124758836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124758836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124758837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:01.497913 run osmo-stp_10.42.42.5(pid=9474): stdout: | (launched: 2022-12-10_12:47:58.637200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:01.635096 run osmo-stp_10.42.42.5(pid=9474): stderr: | [0;m[38;5;43m20221210124758835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124758835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124758835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124758836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124758836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124758836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124758837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:01.797207 run patchelf(pid=9477): Terminating (SIGINT) 12:48:01.984239 run patchelf(pid=9477): Terminated: ok {rc=0} 12:48:02.117380 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9474): Process ended prematurely: osmo-stp_10.42.42.5(pid=9474) [trial-2375↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9474)] [trial-2375↪gprs:sysmo↪cs_paging_gprs_active.py:38] 12:48:02.128685 tst cs_paging_gprs_active.py:38: Test FAILED (10.2 sec) 12:48:02.160507 run osmo-hlr_10.42.42.2(pid=9471): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9471)] 12:48:02.211970 run osmo-hlr_10.42.42.2(pid=9471): stdout: | (launched: 2022-12-10_12:47:57.585807) 12:48:02.264302 run osmo-hlr_10.42.42.2(pid=9471): stderr: | [0;m[1;31m20221210124757790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124757790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124757790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124757790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124757790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124757790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124757803 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124757812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124757812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124757812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:02.316610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9464): Terminating (SIGTERM) 12:48:02.358293 run iperf3-srv_10.42.42.10(pid=9465): Terminating (SIGTERM) 12:48:02.400000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9466): Terminating (SIGTERM) 12:48:02.441924 run iperf3-srv_10.42.42.10(pid=9467): Terminating (SIGTERM) 12:48:02.483918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9470): Terminating (SIGTERM) 12:48:02.526230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9473): Terminating (SIGTERM) 12:48:02.568193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9476): Terminating (SIGTERM) 12:48:02.610409 --- ParallelTerminationStrategy: PID 9464 died... 12:48:02.629689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9464): Terminated: ok {rc=0} 12:48:02.676555 --- ParallelTerminationStrategy: PID 9465 died... 12:48:02.695572 run iperf3-srv_10.42.42.10(pid=9465): Terminated {rc=256} 12:48:02.741787 --- ParallelTerminationStrategy: PID 9466 died... 12:48:02.761173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9466): Terminated: ok {rc=0} 12:48:02.808004 --- ParallelTerminationStrategy: PID 9467 died... 12:48:02.827239 run iperf3-srv_10.42.42.10(pid=9467): Terminated {rc=256} 12:48:02.873762 --- ParallelTerminationStrategy: PID 9470 died... 12:48:02.892831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9470): Terminated: ok {rc=0} 12:48:02.939397 --- ParallelTerminationStrategy: PID 9473 died... 12:48:02.958505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9473): Terminated: ok {rc=0} 12:48:03.005573 --- ParallelTerminationStrategy: PID 9476 died... 12:48:03.024828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9476): Terminated: ok {rc=0} 12:48:03.114929 bus /gobi_0: Setting Powered False 12:48:04.215229 bus /gobi_0: Setting Powered False 12:48:05.333988 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo iperf3.py ---------------------------------------------- 12:48:06.485328 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:06.496507 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:48:06.532692 tst iperf3.py: using LAC 28500 12:48:06.658375 tst iperf3.py: using RAC 195 12:48:06.782589 tst iperf3.py: using CellId 28500 12:48:06.908754 tst iperf3.py: using BVCI 28501 12:48:07.024712 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:07.035351 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:07.045803 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:07.056458 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:07.067062 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:07.077608 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:07.088254 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:07.098870 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:07.109634 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:48:07.231076 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:48:07.460247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:48:07.800245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9478): Launched 12:48:08.095666 run iperf3-srv_10.42.42.10(pid=9479): Launched 12:48:08.223652 tst iperf3.py:8: start network... 12:48:08.451761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:08.976463 run create_hlr_db(pid=9480): Launched 12:48:09.114987 bus /gobi_6: Setting Powered False 12:48:10.180281 run create_hlr_db(pid=9480): Terminated: ok {rc=0} 12:48:10.632023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9482): Launched 12:48:10.951069 run osmo-hlr_10.42.42.2(pid=9483): Launched 12:48:11.073404 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:11.638189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9485): Launched 12:48:11.955771 run osmo-stp_10.42.42.5(pid=9486): Launched 12:48:12.078265 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:48:12.624309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9488): Launched 12:48:12.747291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:48:13.016617 run patchelf(pid=9489): Launched 12:48:13.193892 run osmo-stp_10.42.42.5(pid=9486): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9486)] 12:48:13.327448 run osmo-stp_10.42.42.5(pid=9486): stdout: | (launched: 2022-12-10_12:48:11.895867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:13.462914 run osmo-stp_10.42.42.5(pid=9486): stderr: | [0;m[38;5;43m20221210124812070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124812070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124812070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124812070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124812071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124812071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124812071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:13.598371 run osmo-stp_10.42.42.5(pid=9486): stdout: | (launched: 2022-12-10_12:48:11.895867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:13.728117 run osmo-stp_10.42.42.5(pid=9486): stderr: | [0;m[38;5;43m20221210124812070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124812070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124812070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124812070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124812071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124812071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124812071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:13.881955 run patchelf(pid=9489): Terminating (SIGINT) 12:48:14.059246 run patchelf(pid=9489): Terminated: ok {rc=0} 12:48:14.187082 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9486): Process ended prematurely: osmo-stp_10.42.42.5(pid=9486) [trial-2375↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9486)] [trial-2375↪gprs:sysmo↪iperf3.py:8] 12:48:14.196677 tst iperf3.py:8: Test FAILED (7.8 sec) 12:48:14.224679 run osmo-hlr_10.42.42.2(pid=9483): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9483)] 12:48:14.273293 run osmo-hlr_10.42.42.2(pid=9483): stdout: | (launched: 2022-12-10_12:48:10.891351) 12:48:14.323845 run osmo-hlr_10.42.42.2(pid=9483): stderr: | [0;m[1;31m20221210124811072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124811072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124811072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124811072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124811072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124811072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124811084 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124811092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124811092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124811092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:14.374985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9478): Terminating (SIGTERM) 12:48:14.415998 run iperf3-srv_10.42.42.10(pid=9479): Terminating (SIGTERM) 12:48:14.458262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9482): Terminating (SIGTERM) 12:48:14.499779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9485): Terminating (SIGTERM) 12:48:14.540441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9488): Terminating (SIGTERM) 12:48:14.581408 --- ParallelTerminationStrategy: PID 9478 died... 12:48:14.600805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9478): Terminated: ok {rc=0} 12:48:14.646454 --- ParallelTerminationStrategy: PID 9479 died... 12:48:14.665548 run iperf3-srv_10.42.42.10(pid=9479): Terminated {rc=256} 12:48:14.710799 --- ParallelTerminationStrategy: PID 9482 died... 12:48:14.729793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9482): Terminated: ok {rc=0} 12:48:14.774908 --- ParallelTerminationStrategy: PID 9485 died... 12:48:14.793884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9485): Terminated: ok {rc=0} 12:48:14.839232 --- ParallelTerminationStrategy: PID 9488 died... 12:48:14.858334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9488): Terminated: ok {rc=0} 12:48:14.943756 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo iperf3m4.py ---------------------------------------------- 12:48:16.096088 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:16.109275 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:48:16.147965 tst iperf3m4.py: using LAC 28501 12:48:16.272895 tst iperf3m4.py: using RAC 196 12:48:16.399951 tst iperf3m4.py: using CellId 28501 12:48:16.560611 tst iperf3m4.py: using BVCI 28502 12:48:16.678634 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:16.689981 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:16.700869 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:16.712168 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:16.723333 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:16.734382 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:16.745609 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:16.756619 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:16.768055 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:48:16.888533 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:48:17.014149 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:48:17.143418 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:48:17.298837 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:48:17.533586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:48:17.873618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9490): Launched 12:48:18.171550 run iperf3-srv_10.42.42.10(pid=9491): Launched 12:48:18.298768 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:48:18.527761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:48:18.868518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9492): Launched 12:48:19.162837 run iperf3-srv_10.42.42.10(pid=9493): Launched 12:48:19.289167 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:48:19.517652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:48:19.857254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9494): Launched 12:48:20.153129 run iperf3-srv_10.42.42.10(pid=9495): Launched 12:48:20.280549 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:48:20.508424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:48:20.848491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9496): Launched 12:48:21.159142 run iperf3-srv_10.42.42.10(pid=9497): Launched 12:48:21.286870 tst iperf3m4.py:8: start network... 12:48:21.514830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:22.041358 run create_hlr_db(pid=9498): Launched 12:48:22.177876 bus /gobi_6: Setting Powered False 12:48:23.243814 run create_hlr_db(pid=9498): Terminated: ok {rc=0} 12:48:23.711205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9500): Launched 12:48:24.050878 run osmo-hlr_10.42.42.2(pid=9501): Launched 12:48:24.179607 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:24.761243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9503): Launched 12:48:25.100305 run osmo-stp_10.42.42.5(pid=9504): Launched 12:48:25.230727 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:48:25.813152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9506): Launched 12:48:25.942628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:48:26.228774 run patchelf(pid=9507): Launched 12:48:26.416477 run osmo-stp_10.42.42.5(pid=9504): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9504)] 12:48:26.558355 run osmo-stp_10.42.42.5(pid=9504): stdout: | (launched: 2022-12-10_12:48:25.036876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:26.702297 run osmo-stp_10.42.42.5(pid=9504): stderr: | [0;m[38;5;43m20221210124825235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124825235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124825235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124825235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124825236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124825236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124825236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:26.846344 run osmo-stp_10.42.42.5(pid=9504): stdout: | (launched: 2022-12-10_12:48:25.036876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:26.983917 run osmo-stp_10.42.42.5(pid=9504): stderr: | [0;m[38;5;43m20221210124825235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124825235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124825235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124825235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124825236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124825236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124825236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:27.147308 run patchelf(pid=9507): Terminating (SIGINT) 12:48:27.335198 run patchelf(pid=9507): Terminated: ok {rc=0} 12:48:27.470840 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9504): Process ended prematurely: osmo-stp_10.42.42.5(pid=9504) [trial-2375↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9504)] [trial-2375↪gprs:sysmo↪iperf3m4.py:8] 12:48:27.480906 tst iperf3m4.py:8: Test FAILED (11.4 sec) 12:48:27.509999 run osmo-hlr_10.42.42.2(pid=9501): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9501)] 12:48:27.560647 run osmo-hlr_10.42.42.2(pid=9501): stdout: | (launched: 2022-12-10_12:48:23.987748) 12:48:27.613144 run osmo-hlr_10.42.42.2(pid=9501): stderr: | [0;m[1;31m20221210124824191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124824191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124824192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124824192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124824192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124824192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124824203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124824212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124824213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124824213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:27.665754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9490): Terminating (SIGTERM) 12:48:27.707946 run iperf3-srv_10.42.42.10(pid=9491): Terminating (SIGTERM) 12:48:27.750410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9492): Terminating (SIGTERM) 12:48:27.792725 run iperf3-srv_10.42.42.10(pid=9493): Terminating (SIGTERM) 12:48:27.834979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9494): Terminating (SIGTERM) 12:48:27.877347 run iperf3-srv_10.42.42.10(pid=9495): Terminating (SIGTERM) 12:48:27.919381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9496): Terminating (SIGTERM) 12:48:27.961588 run iperf3-srv_10.42.42.10(pid=9497): Terminating (SIGTERM) 12:48:28.003735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9500): Terminating (SIGTERM) 12:48:28.046274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9503): Terminating (SIGTERM) 12:48:28.088513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9506): Terminating (SIGTERM) 12:48:28.131111 --- ParallelTerminationStrategy: PID 9490 died... 12:48:28.151435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9490): Terminated: ok {rc=0} 12:48:28.198255 --- ParallelTerminationStrategy: PID 9491 died... 12:48:28.217952 run iperf3-srv_10.42.42.10(pid=9491): Terminated {rc=256} 12:48:28.264272 --- ParallelTerminationStrategy: PID 9492 died... 12:48:28.284181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9492): Terminated: ok {rc=0} 12:48:28.331156 --- ParallelTerminationStrategy: PID 9493 died... 12:48:28.351110 run iperf3-srv_10.42.42.10(pid=9493): Terminated {rc=256} 12:48:28.398366 --- ParallelTerminationStrategy: PID 9494 died... 12:48:28.418381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9494): Terminated: ok {rc=0} 12:48:28.465416 --- ParallelTerminationStrategy: PID 9495 died... 12:48:28.485662 run iperf3-srv_10.42.42.10(pid=9495): Terminated {rc=256} 12:48:28.532437 --- ParallelTerminationStrategy: PID 9496 died... 12:48:28.552465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9496): Terminated: ok {rc=0} 12:48:28.599333 --- ParallelTerminationStrategy: PID 9497 died... 12:48:28.619148 run iperf3-srv_10.42.42.10(pid=9497): Terminated {rc=256} 12:48:28.666019 --- ParallelTerminationStrategy: PID 9500 died... 12:48:28.686116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9500): Terminated: ok {rc=0} 12:48:28.733550 --- ParallelTerminationStrategy: PID 9503 died... 12:48:28.753811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9503): Terminated: ok {rc=0} 12:48:28.800857 --- ParallelTerminationStrategy: PID 9506 died... 12:48:28.821082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9506): Terminated: ok {rc=0} 12:48:28.911211 bus /gobi_4: Setting Powered False 12:48:30.012263 bus /gobi_4: Setting Powered False 12:48:31.145624 bus /gobi_1: Setting Powered False 12:48:32.261309 bus /gobi_1: Setting Powered False 12:48:33.378515 bus /gobi_0: Setting Powered False 12:48:34.478720 bus /gobi_0: Setting Powered False 12:48:35.597751 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo ping.py ---------------------------------------------- 12:48:36.703252 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:36.715162 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:48:36.752586 tst ping.py: using LAC 28502 12:48:36.887274 tst ping.py: using RAC 197 12:48:37.011833 tst ping.py: using CellId 28502 12:48:37.141420 tst ping.py: using BVCI 28503 12:48:37.262454 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:37.273647 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:37.284626 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:37.295572 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:37.306385 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:37.317086 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:37.328078 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:37.338940 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:48:37.455556 tst ping.py:19: start network... 12:48:37.666885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:38.151440 run create_hlr_db(pid=9508): Launched 12:48:38.271928 bus /gobi_6: Setting Powered False 12:48:39.334308 run create_hlr_db(pid=9508): Terminated: ok {rc=0} 12:48:39.775105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9510): Launched 12:48:40.088882 run osmo-hlr_10.42.42.2(pid=9511): Launched 12:48:40.208439 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:40.762516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9513): Launched 12:48:41.077338 run osmo-stp_10.42.42.5(pid=9514): Launched 12:48:41.195634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:48:41.734645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9516): Launched 12:48:41.855222 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:48:42.119773 run patchelf(pid=9517): Launched 12:48:42.294531 run osmo-stp_10.42.42.5(pid=9514): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9514)] 12:48:42.426605 run osmo-stp_10.42.42.5(pid=9514): stdout: | (launched: 2022-12-10_12:48:41.018215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:42.559728 run osmo-stp_10.42.42.5(pid=9514): stderr: | [0;m[38;5;43m20221210124841192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124841193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124841193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124841193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124841195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124841196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124841196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:42.693092 run osmo-stp_10.42.42.5(pid=9514): stdout: | (launched: 2022-12-10_12:48:41.018215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:42.820876 run osmo-stp_10.42.42.5(pid=9514): stderr: | [0;m[38;5;43m20221210124841192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124841193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124841193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124841193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124841195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124841196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124841196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:42.973121 run patchelf(pid=9517): Terminating (SIGINT) 12:48:43.148244 run patchelf(pid=9517): Terminated: ok {rc=0} 12:48:43.274084 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9514): Process ended prematurely: osmo-stp_10.42.42.5(pid=9514) [trial-2375↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9514)] [trial-2375↪gprs:sysmo↪ping.py:22] 12:48:43.282887 tst ping.py:22: Test FAILED (6.6 sec) 12:48:43.310645 run osmo-hlr_10.42.42.2(pid=9511): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9511)] 12:48:43.360052 run osmo-hlr_10.42.42.2(pid=9511): stdout: | (launched: 2022-12-10_12:48:40.030081) 12:48:43.410336 run osmo-hlr_10.42.42.2(pid=9511): stderr: | [0;m[1;31m20221210124840208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124840208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124840208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124840208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124840208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124840208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124840220 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124840228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124840228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124840228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:43.461167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9510): Terminating (SIGTERM) 12:48:43.502175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9513): Terminating (SIGTERM) 12:48:43.543046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9516): Terminating (SIGTERM) 12:48:43.584177 --- ParallelTerminationStrategy: PID 9510 died... 12:48:43.603768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9510): Terminated: ok {rc=0} 12:48:43.648840 --- ParallelTerminationStrategy: PID 9513 died... 12:48:43.667897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9513): Terminated: ok {rc=0} 12:48:43.713158 --- ParallelTerminationStrategy: PID 9516 died... 12:48:43.732196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9516): Terminated: ok {rc=0} 12:48:43.819787 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 12:48:44.908560 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:44.919881 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:48:44.960420 tst ping_idle_ping.py: using LAC 28503 12:48:45.083729 tst ping_idle_ping.py: using RAC 198 12:48:45.207841 tst ping_idle_ping.py: using CellId 28503 12:48:45.330282 tst ping_idle_ping.py: using BVCI 28504 12:48:45.446289 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:45.457517 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:45.468065 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:45.478979 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:45.489906 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:45.500585 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:45.511530 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:48:45.522434 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:48:45.648724 tst ping_idle_ping.py:24: start network... 12:48:45.870266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:46.369570 run create_hlr_db(pid=9518): Launched 12:48:46.531978 bus /gobi_6: Setting Powered False 12:48:47.594211 run create_hlr_db(pid=9518): Terminated: ok {rc=0} 12:48:48.049804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9520): Launched 12:48:48.382802 run osmo-hlr_10.42.42.2(pid=9521): Launched 12:48:48.511571 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:49.086960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9523): Launched 12:48:49.420893 run osmo-stp_10.42.42.5(pid=9524): Launched 12:48:49.547983 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:48:50.123994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9526): Launched 12:48:50.251517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:48:50.534568 run patchelf(pid=9527): Launched 12:48:50.719319 run osmo-stp_10.42.42.5(pid=9524): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9524)] 12:48:50.859707 run osmo-stp_10.42.42.5(pid=9524): stdout: | (launched: 2022-12-10_12:48:49.358328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:51.001851 run osmo-stp_10.42.42.5(pid=9524): stderr: | [0;m[38;5;43m20221210124849553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124849553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124849553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124849554 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124849554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124849554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124849554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:51.143373 run osmo-stp_10.42.42.5(pid=9524): stdout: | (launched: 2022-12-10_12:48:49.358328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:51.281779 run osmo-stp_10.42.42.5(pid=9524): stderr: | [0;m[38;5;43m20221210124849553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124849553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124849553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124849554 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124849554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124849554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124849554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:51.443810 run patchelf(pid=9527): Terminating (SIGINT) 12:48:51.629864 run patchelf(pid=9527): Terminated: ok {rc=0} 12:48:51.763846 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9524): Process ended prematurely: osmo-stp_10.42.42.5(pid=9524) [trial-2375↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9524)] [trial-2375↪gprs:sysmo↪ping_idle_ping.py:27] 12:48:51.773618 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 12:48:51.801636 run osmo-hlr_10.42.42.2(pid=9521): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9521)] 12:48:51.851729 run osmo-hlr_10.42.42.2(pid=9521): stdout: | (launched: 2022-12-10_12:48:48.320334) 12:48:51.903866 run osmo-hlr_10.42.42.2(pid=9521): stderr: | [0;m[1;31m20221210124848524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124848524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124848524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124848524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124848524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124848524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124848567 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124848577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124848578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124848578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:51.956134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9520): Terminating (SIGTERM) 12:48:51.998108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9523): Terminating (SIGTERM) 12:48:52.040038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9526): Terminating (SIGTERM) 12:48:52.082345 --- ParallelTerminationStrategy: PID 9520 died... 12:48:52.102534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9520): Terminated: ok {rc=0} 12:48:52.149053 --- ParallelTerminationStrategy: PID 9523 died... 12:48:52.168691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9523): Terminated: ok {rc=0} 12:48:52.215415 --- ParallelTerminationStrategy: PID 9526 died... 12:48:52.235229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9526): Terminated: ok {rc=0} 12:48:52.325244 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 12:48:53.616359 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:53.622139 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:48:53.643640 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:48:53.683240 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:48:53.772474 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:48:53.793814 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:48:53.833179 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:48:54.427347 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:48:54.481745 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:48:54.493150 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:48:54.531159 tst cs_paging_gprs_active.py: using LAC 28504 12:48:54.667459 tst cs_paging_gprs_active.py: using RAC 199 12:48:54.800103 tst cs_paging_gprs_active.py: using CellId 28504 12:48:54.927192 tst cs_paging_gprs_active.py: using BVCI 28505 12:48:55.044255 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:48:55.055413 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:48:55.066222 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:48:55.077526 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:48:55.088436 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:48:55.099606 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:48:55.110893 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:48:55.123143 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:48:55.135047 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:48:55.258636 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:48:55.383801 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:48:55.613584 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:48:55.954593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9531): Launched 12:48:56.251158 run iperf3-srv_10.42.42.10(pid=9532): Launched 12:48:56.378905 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:48:56.608064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:48:56.949506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9533): Launched 12:48:57.248597 run iperf3-srv_10.42.42.10(pid=9534): Launched 12:48:57.375855 tst cs_paging_gprs_active.py:38: start network... 12:48:57.605357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:58.133599 run create_hlr_db(pid=9535): Launched 12:48:58.271847 bus /gobi_6: Setting Powered False 12:48:59.337201 run create_hlr_db(pid=9535): Terminated: ok {rc=0} 12:48:59.788592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9537): Launched 12:49:00.108830 run osmo-hlr_10.42.42.2(pid=9538): Launched 12:49:00.230909 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:00.793108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9540): Launched 12:49:01.119643 run osmo-stp_10.42.42.5(pid=9541): Launched 12:49:01.363753 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:49:02.051054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9543): Launched 12:49:02.200084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:49:02.488818 run patchelf(pid=9544): Launched 12:49:02.677581 run osmo-stp_10.42.42.5(pid=9541): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9541)] 12:49:02.819780 run osmo-stp_10.42.42.5(pid=9541): stdout: | (launched: 2022-12-10_12:49:01.058853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:02.963719 run osmo-stp_10.42.42.5(pid=9541): stderr: | [0;m[38;5;43m20221210124901387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124901387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124901388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124901388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124901398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124901399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124901399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:03.108512 run osmo-stp_10.42.42.5(pid=9541): stdout: | (launched: 2022-12-10_12:49:01.058853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:03.246973 run osmo-stp_10.42.42.5(pid=9541): stderr: | [0;m[38;5;43m20221210124901387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124901387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124901388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124901388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124901398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124901399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124901399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:03.411571 run patchelf(pid=9544): Terminating (SIGINT) 12:49:03.600468 run patchelf(pid=9544): Terminated: ok {rc=0} 12:49:03.736457 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9541): Process ended prematurely: osmo-stp_10.42.42.5(pid=9541) [trial-2375↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9541)] [trial-2375↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:49:03.746815 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 12:49:03.775822 run osmo-hlr_10.42.42.2(pid=9538): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9538)] 12:49:03.826880 run osmo-hlr_10.42.42.2(pid=9538): stdout: | (launched: 2022-12-10_12:49:00.049173) 12:49:03.879912 run osmo-hlr_10.42.42.2(pid=9538): stderr: | [0;m[1;31m20221210124900230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124900230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124900230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124900230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124900230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124900230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124900242 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124900250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124900250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124900250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:03.933285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9531): Terminating (SIGTERM) 12:49:03.975925 run iperf3-srv_10.42.42.10(pid=9532): Terminating (SIGTERM) 12:49:04.018849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9533): Terminating (SIGTERM) 12:49:04.061709 run iperf3-srv_10.42.42.10(pid=9534): Terminating (SIGTERM) 12:49:04.104374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9537): Terminating (SIGTERM) 12:49:04.147273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9540): Terminating (SIGTERM) 12:49:04.189953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9543): Terminating (SIGTERM) 12:49:04.233194 --- ParallelTerminationStrategy: PID 9531 died... 12:49:04.253756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9531): Terminated: ok {rc=0} 12:49:04.301158 --- ParallelTerminationStrategy: PID 9532 died... 12:49:04.321081 run iperf3-srv_10.42.42.10(pid=9532): Terminated {rc=256} 12:49:04.367986 --- ParallelTerminationStrategy: PID 9533 died... 12:49:04.388012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9533): Terminated: ok {rc=0} 12:49:04.435189 --- ParallelTerminationStrategy: PID 9534 died... 12:49:04.455217 run iperf3-srv_10.42.42.10(pid=9534): Terminated {rc=256} 12:49:04.501988 --- ParallelTerminationStrategy: PID 9537 died... 12:49:04.521870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9537): Terminated: ok {rc=0} 12:49:04.568555 --- ParallelTerminationStrategy: PID 9540 died... 12:49:04.588413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9540): Terminated: ok {rc=0} 12:49:04.635277 --- ParallelTerminationStrategy: PID 9543 died... 12:49:04.655322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9543): Terminated: ok {rc=0} 12:49:04.744559 bus /gobi_0: Setting Powered False 12:49:05.844630 bus /gobi_0: Setting Powered False 12:49:06.961381 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:49:08.114750 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:08.126903 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:49:08.168188 tst iperf3.py: using LAC 28505 12:49:08.300909 tst iperf3.py: using RAC 200 12:49:08.431923 tst iperf3.py: using CellId 28505 12:49:08.562913 tst iperf3.py: using BVCI 28506 12:49:08.685773 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:08.697003 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:08.708184 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:08.719247 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:08.730193 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:08.741204 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:08.752393 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:08.763473 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:08.774715 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:49:08.898746 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:49:09.127099 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:49:09.466717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9545): Launched 12:49:09.762682 run iperf3-srv_10.42.42.10(pid=9546): Launched 12:49:09.889371 tst iperf3.py:8: start network... 12:49:10.117386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:10.644329 run create_hlr_db(pid=9547): Launched 12:49:10.782204 bus /gobi_6: Setting Powered False 12:49:11.848513 run create_hlr_db(pid=9547): Terminated: ok {rc=0} 12:49:12.336818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9549): Launched 12:49:12.677508 run osmo-hlr_10.42.42.2(pid=9550): Launched 12:49:12.809398 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:13.393969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9552): Launched 12:49:13.732839 run osmo-stp_10.42.42.5(pid=9553): Launched 12:49:13.863678 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:49:14.449548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9555): Launched 12:49:14.580438 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:49:14.869334 run patchelf(pid=9556): Launched 12:49:15.058272 run osmo-stp_10.42.42.5(pid=9553): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9553)] 12:49:15.201525 run osmo-stp_10.42.42.5(pid=9553): stdout: | (launched: 2022-12-10_12:49:13.669858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:15.346077 run osmo-stp_10.42.42.5(pid=9553): stderr: | [0;m[38;5;43m20221210124913866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124913866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124913867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124913867 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124913868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124913868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124913868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:15.491186 run osmo-stp_10.42.42.5(pid=9553): stdout: | (launched: 2022-12-10_12:49:13.669858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:15.630441 run osmo-stp_10.42.42.5(pid=9553): stderr: | [0;m[38;5;43m20221210124913866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124913866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124913867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124913867 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124913868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124913868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124913868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:15.794846 run patchelf(pid=9556): Terminating (SIGINT) 12:49:16.002199 run patchelf(pid=9556): Terminated: ok {rc=0} 12:49:16.140487 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9553): Process ended prematurely: osmo-stp_10.42.42.5(pid=9553) [trial-2375↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9553)] [trial-2375↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 12:49:16.151017 tst iperf3.py:8: Test FAILED (8.1 sec) 12:49:16.180556 run osmo-hlr_10.42.42.2(pid=9550): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9550)] 12:49:16.231821 run osmo-hlr_10.42.42.2(pid=9550): stdout: | (launched: 2022-12-10_12:49:12.614465) 12:49:16.285858 run osmo-hlr_10.42.42.2(pid=9550): stderr: | [0;m[1;31m20221210124912820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124912820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124912820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124912820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124912820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124912820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124912833 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124912842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124912842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124912842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:16.341419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9545): Terminating (SIGTERM) 12:49:16.386182 run iperf3-srv_10.42.42.10(pid=9546): Terminating (SIGTERM) 12:49:16.433144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9549): Terminating (SIGTERM) 12:49:16.477676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9552): Terminating (SIGTERM) 12:49:16.521521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9555): Terminating (SIGTERM) 12:49:16.565566 --- ParallelTerminationStrategy: PID 9545 died... 12:49:16.586466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9545): Terminated: ok {rc=0} 12:49:16.635146 --- ParallelTerminationStrategy: PID 9546 died... 12:49:16.655970 run iperf3-srv_10.42.42.10(pid=9546): Terminated {rc=256} 12:49:16.705224 --- ParallelTerminationStrategy: PID 9549 died... 12:49:16.726388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9549): Terminated: ok {rc=0} 12:49:16.775432 --- ParallelTerminationStrategy: PID 9552 died... 12:49:16.796052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9552): Terminated: ok {rc=0} 12:49:16.846138 --- ParallelTerminationStrategy: PID 9555 died... 12:49:16.866447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9555): Terminated: ok {rc=0} 12:49:16.957674 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:49:18.105820 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:18.117541 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:49:18.158749 tst iperf3m4.py: using LAC 28506 12:49:18.283544 tst iperf3m4.py: using RAC 201 12:49:18.413783 tst iperf3m4.py: using CellId 28506 12:49:18.538391 tst iperf3m4.py: using BVCI 28507 12:49:18.656398 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:18.667248 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:18.677989 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:18.688770 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:18.699635 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:18.710465 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:18.721457 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:18.732082 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:18.743087 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:49:18.862023 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:49:18.986802 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:49:19.107939 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:49:19.229959 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:49:19.459215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:49:19.786239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9557): Launched 12:49:20.063970 run iperf3-srv_10.42.42.10(pid=9558): Launched 12:49:20.184791 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:49:20.397562 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:49:20.717526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9559): Launched 12:49:20.996001 run iperf3-srv_10.42.42.10(pid=9560): Launched 12:49:21.116905 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:49:21.329675 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:49:21.650183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9561): Launched 12:49:21.929589 run iperf3-srv_10.42.42.10(pid=9562): Launched 12:49:22.048822 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:49:22.262491 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:49:22.583449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9563): Launched 12:49:22.861680 run iperf3-srv_10.42.42.10(pid=9564): Launched 12:49:22.981124 tst iperf3m4.py:8: start network... 12:49:23.194443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:23.688928 run create_hlr_db(pid=9565): Launched 12:49:23.809274 bus /gobi_6: Setting Powered False 12:49:24.872292 run create_hlr_db(pid=9565): Terminated: ok {rc=0} 12:49:25.332766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9568): Launched 12:49:25.674276 run osmo-hlr_10.42.42.2(pid=9569): Launched 12:49:25.804697 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:26.389390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9571): Launched 12:49:26.731994 run osmo-stp_10.42.42.5(pid=9572): Launched 12:49:26.862128 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:49:27.446511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9574): Launched 12:49:27.575071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:49:27.861937 run patchelf(pid=9575): Launched 12:49:28.049326 run osmo-stp_10.42.42.5(pid=9572): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9572)] 12:49:28.191707 run osmo-stp_10.42.42.5(pid=9572): stdout: | (launched: 2022-12-10_12:49:26.668189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:28.335339 run osmo-stp_10.42.42.5(pid=9572): stderr: | [0;m[38;5;43m20221210124926864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124926864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124926865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124926865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124926866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124926866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124926866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:28.479941 run osmo-stp_10.42.42.5(pid=9572): stdout: | (launched: 2022-12-10_12:49:26.668189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:28.618057 run osmo-stp_10.42.42.5(pid=9572): stderr: | [0;m[38;5;43m20221210124926864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124926864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124926865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124926865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124926866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124926866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124926866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:28.781886 run patchelf(pid=9575): Terminating (SIGINT) 12:49:28.970375 run patchelf(pid=9575): Terminated: ok {rc=0} 12:49:29.106140 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9572): Process ended prematurely: osmo-stp_10.42.42.5(pid=9572) [trial-2375↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9572)] [trial-2375↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 12:49:29.116351 tst iperf3m4.py:8: Test FAILED (11.0 sec) 12:49:29.145308 run osmo-hlr_10.42.42.2(pid=9569): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9569)] 12:49:29.196129 run osmo-hlr_10.42.42.2(pid=9569): stdout: | (launched: 2022-12-10_12:49:25.610896) 12:49:29.248623 run osmo-hlr_10.42.42.2(pid=9569): stderr: | [0;m[1;31m20221210124925815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124925815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124925815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124925815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124925815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124925815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124925828 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124925837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124925838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124925838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:29.301535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9557): Terminating (SIGTERM) 12:49:29.343838 run iperf3-srv_10.42.42.10(pid=9558): Terminating (SIGTERM) 12:49:29.386341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9559): Terminating (SIGTERM) 12:49:29.429425 run iperf3-srv_10.42.42.10(pid=9560): Terminating (SIGTERM) 12:49:29.472071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9561): Terminating (SIGTERM) 12:49:29.514714 run iperf3-srv_10.42.42.10(pid=9562): Terminating (SIGTERM) 12:49:29.557279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9563): Terminating (SIGTERM) 12:49:29.599715 run iperf3-srv_10.42.42.10(pid=9564): Terminating (SIGTERM) 12:49:29.642159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9568): Terminating (SIGTERM) 12:49:29.684632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9571): Terminating (SIGTERM) 12:49:29.727184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9574): Terminating (SIGTERM) 12:49:29.769921 --- ParallelTerminationStrategy: PID 9557 died... 12:49:29.790181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9557): Terminated: ok {rc=0} 12:49:29.837456 --- ParallelTerminationStrategy: PID 9558 died... 12:49:29.857372 run iperf3-srv_10.42.42.10(pid=9558): Terminated {rc=256} 12:49:29.904087 --- ParallelTerminationStrategy: PID 9559 died... 12:49:29.924158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9559): Terminated: ok {rc=0} 12:49:29.971301 --- ParallelTerminationStrategy: PID 9560 died... 12:49:29.991275 run iperf3-srv_10.42.42.10(pid=9560): Terminated {rc=256} 12:49:30.037900 --- ParallelTerminationStrategy: PID 9561 died... 12:49:30.057716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9561): Terminated: ok {rc=0} 12:49:30.104773 --- ParallelTerminationStrategy: PID 9562 died... 12:49:30.124813 run iperf3-srv_10.42.42.10(pid=9562): Terminated {rc=256} 12:49:30.171780 --- ParallelTerminationStrategy: PID 9563 died... 12:49:30.191510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9563): Terminated: ok {rc=0} 12:49:30.238648 --- ParallelTerminationStrategy: PID 9564 died... 12:49:30.258556 run iperf3-srv_10.42.42.10(pid=9564): Terminated {rc=256} 12:49:30.305359 --- ParallelTerminationStrategy: PID 9568 died... 12:49:30.325275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9568): Terminated: ok {rc=0} 12:49:30.371935 --- ParallelTerminationStrategy: PID 9571 died... 12:49:30.391815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9571): Terminated: ok {rc=0} 12:49:30.438867 --- ParallelTerminationStrategy: PID 9574 died... 12:49:30.458722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9574): Terminated: ok {rc=0} 12:49:30.546435 bus /gobi_4: Setting Powered False 12:49:31.651042 bus /gobi_4: Setting Powered False 12:49:32.781093 bus /gobi_1: Setting Powered False 12:49:33.881360 bus /gobi_1: Setting Powered False 12:49:34.999636 bus /gobi_0: Setting Powered False 12:49:36.097422 bus /gobi_0: Setting Powered False 12:49:37.216034 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 12:49:38.321581 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:38.333192 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:49:38.369787 tst ping.py: using LAC 28507 12:49:38.493856 tst ping.py: using RAC 202 12:49:38.619525 tst ping.py: using CellId 28507 12:49:38.751628 tst ping.py: using BVCI 28508 12:49:38.874549 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:38.885988 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:38.897372 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:38.908797 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:38.920208 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:38.931595 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:38.943172 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:38.954450 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:49:39.076940 tst ping.py:19: start network... 12:49:39.301748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:39.819620 run create_hlr_db(pid=9576): Launched 12:49:39.954138 bus /gobi_6: Setting Powered False 12:49:41.019985 run create_hlr_db(pid=9576): Terminated: ok {rc=0} 12:49:41.465150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9578): Launched 12:49:41.780726 run osmo-hlr_10.42.42.2(pid=9579): Launched 12:49:41.900935 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:42.440120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9581): Launched 12:49:42.754691 run osmo-stp_10.42.42.5(pid=9582): Launched 12:49:42.874931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:49:43.411894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9584): Launched 12:49:43.532340 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:49:43.797109 run patchelf(pid=9585): Launched 12:49:43.971394 run osmo-stp_10.42.42.5(pid=9582): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9582)] 12:49:44.102621 run osmo-stp_10.42.42.5(pid=9582): stdout: | (launched: 2022-12-10_12:49:42.695877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:44.235102 run osmo-stp_10.42.42.5(pid=9582): stderr: | [0;m[38;5;43m20221210124942870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124942870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124942870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124942871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124942871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124942871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124942871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:44.367737 run osmo-stp_10.42.42.5(pid=9582): stdout: | (launched: 2022-12-10_12:49:42.695877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:44.495244 run osmo-stp_10.42.42.5(pid=9582): stderr: | [0;m[38;5;43m20221210124942870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124942870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124942870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124942871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124942871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124942871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124942871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:44.646429 run patchelf(pid=9585): Terminating (SIGINT) 12:49:44.820726 run patchelf(pid=9585): Terminated: ok {rc=0} 12:49:44.946231 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9582): Process ended prematurely: osmo-stp_10.42.42.5(pid=9582) [trial-2375↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9582)] [trial-2375↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 12:49:44.955160 tst ping.py:22: Test FAILED (6.6 sec) 12:49:44.983019 run osmo-hlr_10.42.42.2(pid=9579): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9579)] 12:49:45.031836 run osmo-hlr_10.42.42.2(pid=9579): stdout: | (launched: 2022-12-10_12:49:41.721724) 12:49:45.082264 run osmo-hlr_10.42.42.2(pid=9579): stderr: | [0;m[1;31m20221210124941899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124941899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124941899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124941899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124941899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124941899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124941911 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124941920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124941920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124941920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:45.133450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9578): Terminating (SIGTERM) 12:49:45.174233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9581): Terminating (SIGTERM) 12:49:45.214886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9584): Terminating (SIGTERM) 12:49:45.255568 --- ParallelTerminationStrategy: PID 9578 died... 12:49:45.274970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9578): Terminated: ok {rc=0} 12:49:45.320481 --- ParallelTerminationStrategy: PID 9581 died... 12:49:45.339514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9581): Terminated: ok {rc=0} 12:49:45.385492 --- ParallelTerminationStrategy: PID 9584 died... 12:49:45.404457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9584): Terminated: ok {rc=0} 12:49:45.492466 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:49:46.587545 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:46.600396 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:49:46.643395 tst ping_idle_ping.py: using LAC 28508 12:49:46.779701 tst ping_idle_ping.py: using RAC 203 12:49:46.919693 tst ping_idle_ping.py: using CellId 28508 12:49:47.081669 tst ping_idle_ping.py: using BVCI 28509 12:49:47.198127 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:47.210294 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:47.222500 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:47.233927 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:47.244664 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:47.255567 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:47.266684 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:49:47.277326 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:49:47.407739 tst ping_idle_ping.py:24: start network... 12:49:47.633973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:48.150742 run create_hlr_db(pid=9586): Launched 12:49:48.287688 bus /gobi_6: Setting Powered False 12:49:49.353882 run create_hlr_db(pid=9586): Terminated: ok {rc=0} 12:49:49.800942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9588): Launched 12:49:50.116516 run osmo-hlr_10.42.42.2(pid=9589): Launched 12:49:50.237297 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:50.775759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9591): Launched 12:49:51.091005 run osmo-stp_10.42.42.5(pid=9592): Launched 12:49:51.211505 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:49:51.754495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9594): Launched 12:49:51.874753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:49:52.140652 run patchelf(pid=9595): Launched 12:49:52.314239 run osmo-stp_10.42.42.5(pid=9592): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9592)] 12:49:52.446445 run osmo-stp_10.42.42.5(pid=9592): stdout: | (launched: 2022-12-10_12:49:51.031953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:52.580035 run osmo-stp_10.42.42.5(pid=9592): stderr: | [0;m[38;5;43m20221210124951205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124951205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124951206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124951206 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124951208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124951208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124951209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:52.713222 run osmo-stp_10.42.42.5(pid=9592): stdout: | (launched: 2022-12-10_12:49:51.031953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:52.841571 run osmo-stp_10.42.42.5(pid=9592): stderr: | [0;m[38;5;43m20221210124951205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210124951205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210124951206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210124951206 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210124951208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210124951208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210124951209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:52.993315 run patchelf(pid=9595): Terminating (SIGINT) 12:49:53.169025 run patchelf(pid=9595): Terminated: ok {rc=0} 12:49:53.295159 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9592): Process ended prematurely: osmo-stp_10.42.42.5(pid=9592) [trial-2375↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9592)] [trial-2375↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 12:49:53.304352 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:49:53.331923 run osmo-hlr_10.42.42.2(pid=9589): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9589)] 12:49:53.381197 run osmo-hlr_10.42.42.2(pid=9589): stdout: | (launched: 2022-12-10_12:49:50.057621) 12:49:53.431984 run osmo-hlr_10.42.42.2(pid=9589): stderr: | [0;m[1;31m20221210124950236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210124950236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210124950236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210124950236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210124950236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210124950236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210124950273 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210124950283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210124950283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210124950283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:53.483085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9588): Terminating (SIGTERM) 12:49:53.523482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9591): Terminating (SIGTERM) 12:49:53.564114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9594): Terminating (SIGTERM) 12:49:53.605208 --- ParallelTerminationStrategy: PID 9588 died... 12:49:53.625034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9588): Terminated: ok {rc=0} 12:49:53.670337 --- ParallelTerminationStrategy: PID 9591 died... 12:49:53.689268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9591): Terminated: ok {rc=0} 12:49:53.734765 --- ParallelTerminationStrategy: PID 9594 died... 12:49:53.753698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9594): Terminated: ok {rc=0} 12:49:53.842699 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:49:55.139498 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:49:55.146197 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:49:55.168056 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:49:55.208031 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:49:55.299462 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:49:55.322111 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:49:55.361819 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:49:55.953472 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:49:56.007826 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:49:56.019325 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:49:56.077668 tst cs_paging_gprs_active.py: using LAC 28509 12:49:56.211132 tst cs_paging_gprs_active.py: using RAC 204 12:49:56.347201 tst cs_paging_gprs_active.py: using CellId 28509 12:49:56.475606 tst cs_paging_gprs_active.py: using BVCI 28510 12:49:56.592074 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:49:56.603077 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:49:56.613820 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:49:56.625228 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:49:56.636630 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:49:56.647970 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:49:56.659475 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:49:56.670707 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:49:56.682339 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:49:56.806405 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:49:56.930807 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:49:57.159727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:49:57.500412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9599): Launched 12:49:57.797599 run iperf3-srv_10.42.42.10(pid=9600): Launched 12:49:57.926230 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:49:58.154146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:49:58.496001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9601): Launched 12:49:58.793145 run iperf3-srv_10.42.42.10(pid=9602): Launched 12:49:58.921923 tst cs_paging_gprs_active.py:38: start network... 12:49:59.149800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:59.678571 run create_hlr_db(pid=9603): Launched 12:49:59.817920 bus /gobi_6: Setting Powered False 12:50:00.896785 run create_hlr_db(pid=9603): Terminated: ok {rc=0} 12:50:01.352720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9605): Launched 12:50:01.707151 run osmo-hlr_10.42.42.2(pid=9606): Launched 12:50:01.894046 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:02.594258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9611): Launched 12:50:02.934253 run osmo-stp_10.42.42.5(pid=9612): Launched 12:50:03.065573 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:50:03.652718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9614): Launched 12:50:03.782217 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:50:04.070792 run patchelf(pid=9615): Launched 12:50:04.260501 run osmo-stp_10.42.42.5(pid=9612): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9612)] 12:50:04.403062 run osmo-stp_10.42.42.5(pid=9612): stdout: | (launched: 2022-12-10_12:50:02.870830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:04.547611 run osmo-stp_10.42.42.5(pid=9612): stderr: | [0;m[38;5;43m20221210125003064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125003065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125003065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125003065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125003068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125003068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125003068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:04.691482 run osmo-stp_10.42.42.5(pid=9612): stdout: | (launched: 2022-12-10_12:50:02.870830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:04.830027 run osmo-stp_10.42.42.5(pid=9612): stderr: | [0;m[38;5;43m20221210125003064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125003065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125003065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125003065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125003068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125003068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125003068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:04.994151 run patchelf(pid=9615): Terminating (SIGINT) 12:50:05.183383 run patchelf(pid=9615): Terminated: ok {rc=0} 12:50:05.319794 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9612): Process ended prematurely: osmo-stp_10.42.42.5(pid=9612) [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9612)] [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:50:05.330378 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 12:50:05.359460 run osmo-hlr_10.42.42.2(pid=9606): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9606)] 12:50:05.410368 run osmo-hlr_10.42.42.2(pid=9606): stdout: | (launched: 2022-12-10_12:50:01.643119) 12:50:05.463331 run osmo-hlr_10.42.42.2(pid=9606): stderr: | [0;m[1;31m20221210125001962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125001962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125001962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125001962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125001962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125001962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125001980 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125002004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125002007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125002008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:05.517227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9599): Terminating (SIGTERM) 12:50:05.559847 run iperf3-srv_10.42.42.10(pid=9600): Terminating (SIGTERM) 12:50:05.602685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9601): Terminating (SIGTERM) 12:50:05.645525 run iperf3-srv_10.42.42.10(pid=9602): Terminating (SIGTERM) 12:50:05.688237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9605): Terminating (SIGTERM) 12:50:05.730959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9611): Terminating (SIGTERM) 12:50:05.773755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9614): Terminating (SIGTERM) 12:50:05.816713 --- ParallelTerminationStrategy: PID 9599 died... 12:50:05.837120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9599): Terminated: ok {rc=0} 12:50:05.884487 --- ParallelTerminationStrategy: PID 9600 died... 12:50:05.904472 run iperf3-srv_10.42.42.10(pid=9600): Terminated {rc=256} 12:50:05.951490 --- ParallelTerminationStrategy: PID 9601 died... 12:50:05.971512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9601): Terminated: ok {rc=0} 12:50:06.018452 --- ParallelTerminationStrategy: PID 9602 died... 12:50:06.038257 run iperf3-srv_10.42.42.10(pid=9602): Terminated {rc=256} 12:50:06.085062 --- ParallelTerminationStrategy: PID 9605 died... 12:50:06.105016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9605): Terminated: ok {rc=0} 12:50:06.152138 --- ParallelTerminationStrategy: PID 9611 died... 12:50:06.172116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9611): Terminated: ok {rc=0} 12:50:06.219202 --- ParallelTerminationStrategy: PID 9614 died... 12:50:06.239128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9614): Terminated: ok {rc=0} 12:50:06.329142 bus /gobi_0: Setting Powered False 12:50:07.428916 bus /gobi_0: Setting Powered False 12:50:08.548926 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:50:09.703038 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:09.715218 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:50:09.776318 tst iperf3.py: using LAC 28510 12:50:09.902467 tst iperf3.py: using RAC 205 12:50:10.028318 tst iperf3.py: using CellId 28510 12:50:10.154291 tst iperf3.py: using BVCI 28511 12:50:10.270063 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:10.280852 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:10.291562 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:10.302614 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:10.313537 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:10.324312 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:10.335384 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:10.346538 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:10.357699 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:50:10.480058 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:50:10.708650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:50:11.048604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9616): Launched 12:50:11.345412 run iperf3-srv_10.42.42.10(pid=9617): Launched 12:50:11.474597 tst iperf3.py:8: start network... 12:50:11.703837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:50:12.230964 run create_hlr_db(pid=9618): Launched 12:50:12.369695 bus /gobi_6: Setting Powered False 12:50:13.436251 run create_hlr_db(pid=9618): Terminated: ok {rc=0} 12:50:13.904316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9620): Launched 12:50:14.243477 run osmo-hlr_10.42.42.2(pid=9621): Launched 12:50:14.373713 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:14.959925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9623): Launched 12:50:15.297653 run osmo-stp_10.42.42.5(pid=9624): Launched 12:50:15.426844 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:50:16.052002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9626): Launched 12:50:16.186648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:50:16.480574 run patchelf(pid=9627): Launched 12:50:16.684480 run osmo-stp_10.42.42.5(pid=9624): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9624)] 12:50:16.829241 run osmo-stp_10.42.42.5(pid=9624): stdout: | (launched: 2022-12-10_12:50:15.234535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:16.975343 run osmo-stp_10.42.42.5(pid=9624): stderr: | [0;m[38;5;43m20221210125015431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125015432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125015432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125015432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125015433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125015433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125015433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:17.122047 run osmo-stp_10.42.42.5(pid=9624): stdout: | (launched: 2022-12-10_12:50:15.234535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:17.260260 run osmo-stp_10.42.42.5(pid=9624): stderr: | [0;m[38;5;43m20221210125015431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125015432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125015432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125015432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125015433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125015433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125015433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:17.424418 run patchelf(pid=9627): Terminating (SIGINT) 12:50:17.614761 run patchelf(pid=9627): Terminated: ok {rc=0} 12:50:17.751008 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9624): Process ended prematurely: osmo-stp_10.42.42.5(pid=9624) [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9624)] [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 12:50:17.761317 tst iperf3.py:8: Test FAILED (8.1 sec) 12:50:17.790296 run osmo-hlr_10.42.42.2(pid=9621): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9621)] 12:50:17.841527 run osmo-hlr_10.42.42.2(pid=9621): stdout: | (launched: 2022-12-10_12:50:14.179596) 12:50:17.894005 run osmo-hlr_10.42.42.2(pid=9621): stderr: | [0;m[1;31m20221210125014385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125014385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125014385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125014385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125014385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125014385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125014396 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125014405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125014405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125014405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:17.946826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9616): Terminating (SIGTERM) 12:50:17.989558 run iperf3-srv_10.42.42.10(pid=9617): Terminating (SIGTERM) 12:50:18.032111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9620): Terminating (SIGTERM) 12:50:18.074613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9623): Terminating (SIGTERM) 12:50:18.116856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9626): Terminating (SIGTERM) 12:50:18.159732 --- ParallelTerminationStrategy: PID 9616 died... 12:50:18.179982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9616): Terminated: ok {rc=0} 12:50:18.226873 --- ParallelTerminationStrategy: PID 9617 died... 12:50:18.246777 run iperf3-srv_10.42.42.10(pid=9617): Terminated {rc=256} 12:50:18.293360 --- ParallelTerminationStrategy: PID 9620 died... 12:50:18.313290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9620): Terminated: ok {rc=0} 12:50:18.359967 --- ParallelTerminationStrategy: PID 9623 died... 12:50:18.379821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9623): Terminated: ok {rc=0} 12:50:18.427063 --- ParallelTerminationStrategy: PID 9626 died... 12:50:18.447340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9626): Terminated: ok {rc=0} 12:50:18.536858 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:50:19.690232 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:19.702368 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:50:19.761371 tst iperf3m4.py: using LAC 28511 12:50:19.893758 tst iperf3m4.py: using RAC 206 12:50:20.021450 tst iperf3m4.py: using CellId 28511 12:50:20.146400 tst iperf3m4.py: using BVCI 28512 12:50:20.262294 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:20.273460 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:20.284073 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:20.295183 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:20.306146 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:20.316903 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:20.328015 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:20.338901 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:20.350150 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:50:20.472746 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:50:20.597699 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:50:20.722047 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:50:20.843008 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:50:21.056745 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:50:21.376538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9629): Launched 12:50:21.655864 run iperf3-srv_10.42.42.10(pid=9630): Launched 12:50:21.777601 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:50:21.990463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:50:22.309990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9631): Launched 12:50:22.587469 run iperf3-srv_10.42.42.10(pid=9632): Launched 12:50:22.715381 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:50:22.942972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:50:23.283557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9633): Launched 12:50:23.579456 run iperf3-srv_10.42.42.10(pid=9634): Launched 12:50:23.707318 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:50:23.935612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:50:24.276832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9635): Launched 12:50:24.573366 run iperf3-srv_10.42.42.10(pid=9636): Launched 12:50:24.702453 tst iperf3m4.py:8: start network... 12:50:24.931169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:50:25.460150 run create_hlr_db(pid=9637): Launched 12:50:25.597981 bus /gobi_6: Setting Powered False 12:50:26.664202 run create_hlr_db(pid=9637): Terminated: ok {rc=0} 12:50:27.132583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9639): Launched 12:50:27.472167 run osmo-hlr_10.42.42.2(pid=9640): Launched 12:50:27.602241 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:28.188150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9642): Launched 12:50:28.527218 run osmo-stp_10.42.42.5(pid=9643): Launched 12:50:28.655129 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:50:29.239082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9645): Launched 12:50:29.367474 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:50:29.654861 run patchelf(pid=9646): Launched 12:50:29.842063 run osmo-stp_10.42.42.5(pid=9643): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9643)] 12:50:29.983348 run osmo-stp_10.42.42.5(pid=9643): stdout: | (launched: 2022-12-10_12:50:28.463589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:30.126487 run osmo-stp_10.42.42.5(pid=9643): stderr: | [0;m[38;5;43m20221210125028663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125028664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125028664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125028664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125028665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125028665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125028665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:30.269424 run osmo-stp_10.42.42.5(pid=9643): stdout: | (launched: 2022-12-10_12:50:28.463589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:30.406755 run osmo-stp_10.42.42.5(pid=9643): stderr: | [0;m[38;5;43m20221210125028663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125028664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125028664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125028664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125028665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125028665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125028665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:30.570441 run patchelf(pid=9646): Terminating (SIGINT) 12:50:30.758202 run patchelf(pid=9646): Terminated: ok {rc=0} 12:50:30.895463 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9643): Process ended prematurely: osmo-stp_10.42.42.5(pid=9643) [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9643)] [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:50:30.906320 tst iperf3m4.py:8: Test FAILED (11.3 sec) 12:50:30.936591 run osmo-hlr_10.42.42.2(pid=9640): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9640)] 12:50:30.988852 run osmo-hlr_10.42.42.2(pid=9640): stdout: | (launched: 2022-12-10_12:50:27.408250) 12:50:31.041734 run osmo-hlr_10.42.42.2(pid=9640): stderr: | [0;m[1;31m20221210125027615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125027615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125027615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125027615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125027616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125027616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125027628 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125027636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125027637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125027637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:31.094918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9629): Terminating (SIGTERM) 12:50:31.138539 run iperf3-srv_10.42.42.10(pid=9630): Terminating (SIGTERM) 12:50:31.184589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9631): Terminating (SIGTERM) 12:50:31.228034 run iperf3-srv_10.42.42.10(pid=9632): Terminating (SIGTERM) 12:50:31.272608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9633): Terminating (SIGTERM) 12:50:31.315429 run iperf3-srv_10.42.42.10(pid=9634): Terminating (SIGTERM) 12:50:31.359965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9635): Terminating (SIGTERM) 12:50:31.402739 run iperf3-srv_10.42.42.10(pid=9636): Terminating (SIGTERM) 12:50:31.447514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9639): Terminating (SIGTERM) 12:50:31.490543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9642): Terminating (SIGTERM) 12:50:31.533206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9645): Terminating (SIGTERM) 12:50:31.575992 --- ParallelTerminationStrategy: PID 9629 died... 12:50:31.596312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9629): Terminated: ok {rc=0} 12:50:31.643962 --- ParallelTerminationStrategy: PID 9630 died... 12:50:31.664201 run iperf3-srv_10.42.42.10(pid=9630): Terminated {rc=256} 12:50:31.712075 --- ParallelTerminationStrategy: PID 9631 died... 12:50:31.732566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9631): Terminated: ok {rc=0} 12:50:31.780179 --- ParallelTerminationStrategy: PID 9632 died... 12:50:31.800364 run iperf3-srv_10.42.42.10(pid=9632): Terminated {rc=256} 12:50:31.847687 --- ParallelTerminationStrategy: PID 9633 died... 12:50:31.868052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9633): Terminated: ok {rc=0} 12:50:31.916214 --- ParallelTerminationStrategy: PID 9634 died... 12:50:31.942282 run iperf3-srv_10.42.42.10(pid=9634): Terminated {rc=256} 12:50:31.998104 --- ParallelTerminationStrategy: PID 9635 died... 12:50:32.024261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9635): Terminated: ok {rc=0} 12:50:32.082826 --- ParallelTerminationStrategy: PID 9636 died... 12:50:32.108623 run iperf3-srv_10.42.42.10(pid=9636): Terminated {rc=256} 12:50:32.161799 --- ParallelTerminationStrategy: PID 9639 died... 12:50:32.181253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9639): Terminated: ok {rc=0} 12:50:32.229051 --- ParallelTerminationStrategy: PID 9642 died... 12:50:32.248556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9642): Terminated: ok {rc=0} 12:50:32.295974 --- ParallelTerminationStrategy: PID 9645 died... 12:50:32.315250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9645): Terminated: ok {rc=0} 12:50:32.404438 bus /gobi_4: Setting Powered False 12:50:33.504190 bus /gobi_4: Setting Powered False 12:50:34.622873 bus /gobi_1: Setting Powered False 12:50:35.723391 bus /gobi_1: Setting Powered False 12:50:36.841282 bus /gobi_0: Setting Powered False 12:50:37.940672 bus /gobi_0: Setting Powered False 12:50:39.060397 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:50:40.165210 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:40.176904 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:50:40.233984 tst ping.py: using LAC 28512 12:50:40.357107 tst ping.py: using RAC 207 12:50:40.478635 tst ping.py: using CellId 28512 12:50:40.600785 tst ping.py: using BVCI 28513 12:50:40.715381 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:40.726644 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:40.737660 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:40.748838 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:40.760104 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:40.771362 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:40.782945 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:40.794094 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:50:40.915948 tst ping.py:19: start network... 12:50:41.139442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:50:41.655795 run create_hlr_db(pid=9647): Launched 12:50:41.791630 bus /gobi_6: Setting Powered False 12:50:42.856814 run create_hlr_db(pid=9647): Terminated: ok {rc=0} 12:50:43.303196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9649): Launched 12:50:43.620249 run osmo-hlr_10.42.42.2(pid=9650): Launched 12:50:43.741221 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:44.287595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9652): Launched 12:50:44.602049 run osmo-stp_10.42.42.5(pid=9653): Launched 12:50:44.724158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:50:45.261479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9655): Launched 12:50:45.380941 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:50:45.646546 run patchelf(pid=9656): Launched 12:50:45.819915 run osmo-stp_10.42.42.5(pid=9653): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9653)] 12:50:45.985740 run osmo-stp_10.42.42.5(pid=9653): stdout: | (launched: 2022-12-10_12:50:44.543118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:46.131827 run osmo-stp_10.42.42.5(pid=9653): stderr: | [0;m[38;5;43m20221210125044718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125044718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125044718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125044719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125044719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125044719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125044719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:46.294189 run osmo-stp_10.42.42.5(pid=9653): stdout: | (launched: 2022-12-10_12:50:44.543118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:46.442309 run osmo-stp_10.42.42.5(pid=9653): stderr: | [0;m[38;5;43m20221210125044718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125044718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125044718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125044719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125044719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125044719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125044719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:46.609728 run patchelf(pid=9656): Terminating (SIGINT) 12:50:46.802084 run patchelf(pid=9656): Terminated: ok {rc=0} 12:50:46.939598 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9653): Process ended prematurely: osmo-stp_10.42.42.5(pid=9653) [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9653)] [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 12:50:46.950241 tst ping.py:22: Test FAILED (6.8 sec) 12:50:46.980135 run osmo-hlr_10.42.42.2(pid=9650): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9650)] 12:50:47.032312 run osmo-hlr_10.42.42.2(pid=9650): stdout: | (launched: 2022-12-10_12:50:43.561126) 12:50:47.086574 run osmo-hlr_10.42.42.2(pid=9650): stderr: | [0;m[1;31m20221210125043739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125043739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125043739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125043739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125043739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125043739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125043752 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125043762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125043762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125043762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:47.141280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9649): Terminating (SIGTERM) 12:50:47.184636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9652): Terminating (SIGTERM) 12:50:47.227565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9655): Terminating (SIGTERM) 12:50:47.270274 --- ParallelTerminationStrategy: PID 9649 died... 12:50:47.290580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9649): Terminated: ok {rc=0} 12:50:47.337773 --- ParallelTerminationStrategy: PID 9652 died... 12:50:47.357685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9652): Terminated: ok {rc=0} 12:50:47.404121 --- ParallelTerminationStrategy: PID 9655 died... 12:50:47.423725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9655): Terminated: ok {rc=0} 12:50:47.512646 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:50:48.600404 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:48.612191 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:50:48.671097 tst ping_idle_ping.py: using LAC 28513 12:50:48.795414 tst ping_idle_ping.py: using RAC 208 12:50:48.919102 tst ping_idle_ping.py: using CellId 28513 12:50:49.042735 tst ping_idle_ping.py: using BVCI 28514 12:50:49.157677 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:49.168452 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:49.179187 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:49.190657 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:49.202089 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:49.213429 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:49.224868 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:50:49.236244 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:50:49.358589 tst ping_idle_ping.py:24: start network... 12:50:49.583355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:50:50.101260 run create_hlr_db(pid=9657): Launched 12:50:50.238419 bus /gobi_6: Setting Powered False 12:50:51.304012 run create_hlr_db(pid=9657): Terminated: ok {rc=0} 12:50:51.751863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9659): Launched 12:50:52.068159 run osmo-hlr_10.42.42.2(pid=9660): Launched 12:50:52.188805 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:52.744104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9662): Launched 12:50:53.059024 run osmo-stp_10.42.42.5(pid=9663): Launched 12:50:53.179701 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:50:53.718188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9665): Launched 12:50:53.837344 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:50:54.103378 run patchelf(pid=9666): Launched 12:50:54.276826 run osmo-stp_10.42.42.5(pid=9663): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9663)] 12:50:54.409211 run osmo-stp_10.42.42.5(pid=9663): stdout: | (launched: 2022-12-10_12:50:52.999942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:54.542393 run osmo-stp_10.42.42.5(pid=9663): stderr: | [0;m[38;5;43m20221210125053176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125053176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125053176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125053177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125053177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125053177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125053177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:54.675665 run osmo-stp_10.42.42.5(pid=9663): stdout: | (launched: 2022-12-10_12:50:52.999942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:54.803544 run osmo-stp_10.42.42.5(pid=9663): stderr: | [0;m[38;5;43m20221210125053176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125053176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125053176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125053177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125053177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125053177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125053177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:54.955335 run patchelf(pid=9666): Terminating (SIGINT) 12:50:55.130695 run patchelf(pid=9666): Terminated: ok {rc=0} 12:50:55.256590 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9663): Process ended prematurely: osmo-stp_10.42.42.5(pid=9663) [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9663)] [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:50:55.265782 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:50:55.292802 run osmo-hlr_10.42.42.2(pid=9660): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9660)] 12:50:55.341568 run osmo-hlr_10.42.42.2(pid=9660): stdout: | (launched: 2022-12-10_12:50:52.009377) 12:50:55.391515 run osmo-hlr_10.42.42.2(pid=9660): stderr: | [0;m[1;31m20221210125052191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125052191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125052191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125052191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125052191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125052191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125052203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125052214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125052214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125052214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:55.442112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9659): Terminating (SIGTERM) 12:50:55.482519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9662): Terminating (SIGTERM) 12:50:55.522903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9665): Terminating (SIGTERM) 12:50:55.564265 --- ParallelTerminationStrategy: PID 9659 died... 12:50:55.584052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9659): Terminated: ok {rc=0} 12:50:55.629403 --- ParallelTerminationStrategy: PID 9662 died... 12:50:55.648176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9662): Terminated: ok {rc=0} 12:50:55.693311 --- ParallelTerminationStrategy: PID 9665 died... 12:50:55.712681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9665): Terminated: ok {rc=0} 12:50:55.799477 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:50:57.090165 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:50:57.096207 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:50:57.119049 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:50:57.160021 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:50:57.248062 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:50:57.269345 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:50:57.308919 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:50:57.900839 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:50:57.953995 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:50:57.964829 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:50:58.021387 tst cs_paging_gprs_active.py: using LAC 28514 12:50:58.144932 tst cs_paging_gprs_active.py: using RAC 209 12:50:58.270768 tst cs_paging_gprs_active.py: using CellId 28514 12:50:58.393955 tst cs_paging_gprs_active.py: using BVCI 28515 12:50:58.512604 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:50:58.523503 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:50:58.534151 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:50:58.545668 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:50:58.557020 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:50:58.568473 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:50:58.580177 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:50:58.591611 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:50:58.603390 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:50:58.727944 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:50:58.846900 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:50:59.061269 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:50:59.381705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9670): Launched 12:50:59.661501 run iperf3-srv_10.42.42.10(pid=9671): Launched 12:50:59.783861 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:50:59.997813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:51:00.317985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9672): Launched 12:51:00.596062 run iperf3-srv_10.42.42.10(pid=9673): Launched 12:51:00.717079 tst cs_paging_gprs_active.py:38: start network... 12:51:00.949683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:01.491682 run create_hlr_db(pid=9674): Launched 12:51:01.667471 bus /gobi_6: Setting Powered False 12:51:02.730950 run create_hlr_db(pid=9674): Terminated: ok {rc=0} 12:51:03.208913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9676): Launched 12:51:03.550066 run osmo-hlr_10.42.42.2(pid=9677): Launched 12:51:03.681828 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:04.265626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9679): Launched 12:51:04.608822 run osmo-stp_10.42.42.5(pid=9680): Launched 12:51:04.739656 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:51:05.324505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9682): Launched 12:51:05.455342 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:51:05.743242 run patchelf(pid=9683): Launched 12:51:05.930143 run osmo-stp_10.42.42.5(pid=9680): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9680)] 12:51:06.073182 run osmo-stp_10.42.42.5(pid=9680): stdout: | (launched: 2022-12-10_12:51:04.545048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:06.217265 run osmo-stp_10.42.42.5(pid=9680): stderr: | [0;m[38;5;43m20221210125104746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125104746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125104746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125104747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125104747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125104747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125104747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:06.361211 run osmo-stp_10.42.42.5(pid=9680): stdout: | (launched: 2022-12-10_12:51:04.545048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:06.499701 run osmo-stp_10.42.42.5(pid=9680): stderr: | [0;m[38;5;43m20221210125104746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125104746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125104746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125104747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125104747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125104747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125104747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:06.663945 run patchelf(pid=9683): Terminating (SIGINT) 12:51:06.853057 run patchelf(pid=9683): Terminated: ok {rc=0} 12:51:06.989281 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9680): Process ended prematurely: osmo-stp_10.42.42.5(pid=9680) [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9680)] [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:51:06.999635 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 12:51:07.028541 run osmo-hlr_10.42.42.2(pid=9677): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9677)] 12:51:07.079066 run osmo-hlr_10.42.42.2(pid=9677): stdout: | (launched: 2022-12-10_12:51:03.486567) 12:51:07.131172 run osmo-hlr_10.42.42.2(pid=9677): stderr: | [0;m[1;31m20221210125103688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125103688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125103688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125103688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125103688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125103688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125103700 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125103709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125103710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125103710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:07.183870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9670): Terminating (SIGTERM) 12:51:07.225895 run iperf3-srv_10.42.42.10(pid=9671): Terminating (SIGTERM) 12:51:07.267851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9672): Terminating (SIGTERM) 12:51:07.310191 run iperf3-srv_10.42.42.10(pid=9673): Terminating (SIGTERM) 12:51:07.352129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9676): Terminating (SIGTERM) 12:51:07.394296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9679): Terminating (SIGTERM) 12:51:07.436210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9682): Terminating (SIGTERM) 12:51:07.478748 --- ParallelTerminationStrategy: PID 9670 died... 12:51:07.498907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9670): Terminated: ok {rc=0} 12:51:07.545649 --- ParallelTerminationStrategy: PID 9671 died... 12:51:07.565264 run iperf3-srv_10.42.42.10(pid=9671): Terminated {rc=256} 12:51:07.611582 --- ParallelTerminationStrategy: PID 9672 died... 12:51:07.631233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9672): Terminated: ok {rc=0} 12:51:07.677465 --- ParallelTerminationStrategy: PID 9673 died... 12:51:07.696911 run iperf3-srv_10.42.42.10(pid=9673): Terminated {rc=256} 12:51:07.742985 --- ParallelTerminationStrategy: PID 9676 died... 12:51:07.762492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9676): Terminated: ok {rc=0} 12:51:07.808620 --- ParallelTerminationStrategy: PID 9679 died... 12:51:07.828176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9679): Terminated: ok {rc=0} 12:51:07.874252 --- ParallelTerminationStrategy: PID 9682 died... 12:51:07.893896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9682): Terminated: ok {rc=0} 12:51:07.982256 bus /gobi_0: Setting Powered False 12:51:09.081660 bus /gobi_0: Setting Powered False 12:51:10.199948 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:51:11.349861 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:11.361579 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:51:11.421890 tst iperf3.py: using LAC 28515 12:51:11.548439 tst iperf3.py: using RAC 210 12:51:11.675005 tst iperf3.py: using CellId 28515 12:51:11.801720 tst iperf3.py: using BVCI 28516 12:51:11.919802 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:11.930816 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:11.941611 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:11.952488 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:11.963387 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:11.974295 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:11.985348 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:11.996386 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:12.007464 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:51:12.131269 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:51:12.360134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:51:12.702045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9685): Launched 12:51:12.998000 run iperf3-srv_10.42.42.10(pid=9686): Launched 12:51:13.127161 tst iperf3.py:8: start network... 12:51:13.355845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:13.883668 run create_hlr_db(pid=9687): Launched 12:51:14.022002 bus /gobi_6: Setting Powered False 12:51:15.088121 run create_hlr_db(pid=9687): Terminated: ok {rc=0} 12:51:15.539045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9689): Launched 12:51:15.882048 run osmo-hlr_10.42.42.2(pid=9690): Launched 12:51:16.036587 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:16.823438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9692): Launched 12:51:17.161153 run osmo-stp_10.42.42.5(pid=9693): Launched 12:51:17.338824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:51:17.899378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9695): Launched 12:51:18.022525 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:51:18.293792 run patchelf(pid=9696): Launched 12:51:18.470015 run osmo-stp_10.42.42.5(pid=9693): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9693)] 12:51:18.603854 run osmo-stp_10.42.42.5(pid=9693): stdout: | (launched: 2022-12-10_12:51:17.099756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:18.739882 run osmo-stp_10.42.42.5(pid=9693): stderr: | [0;m[38;5;43m20221210125117347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125117348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125117348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125117348 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125117349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125117349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125117349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:18.876033 run osmo-stp_10.42.42.5(pid=9693): stdout: | (launched: 2022-12-10_12:51:17.099756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:19.007217 run osmo-stp_10.42.42.5(pid=9693): stderr: | [0;m[38;5;43m20221210125117347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125117348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125117348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125117348 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125117349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125117349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125117349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:19.161355 run patchelf(pid=9696): Terminating (SIGINT) 12:51:19.340117 run patchelf(pid=9696): Terminated: ok {rc=0} 12:51:19.468651 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9693): Process ended prematurely: osmo-stp_10.42.42.5(pid=9693) [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9693)] [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 12:51:19.478895 tst iperf3.py:8: Test FAILED (8.2 sec) 12:51:19.506966 run osmo-hlr_10.42.42.2(pid=9690): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9690)] 12:51:19.555947 run osmo-hlr_10.42.42.2(pid=9690): stdout: | (launched: 2022-12-10_12:51:15.800425) 12:51:19.606695 run osmo-hlr_10.42.42.2(pid=9690): stderr: | [0;m[1;31m20221210125116139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125116140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125116140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125116140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125116140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125116140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125116155 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125116164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125116164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125116164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:19.657653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9685): Terminating (SIGTERM) 12:51:19.698392 run iperf3-srv_10.42.42.10(pid=9686): Terminating (SIGTERM) 12:51:19.738766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9689): Terminating (SIGTERM) 12:51:19.779547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9692): Terminating (SIGTERM) 12:51:19.820029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9695): Terminating (SIGTERM) 12:51:19.860843 --- ParallelTerminationStrategy: PID 9685 died... 12:51:19.880313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9685): Terminated: ok {rc=0} 12:51:19.925954 --- ParallelTerminationStrategy: PID 9686 died... 12:51:19.944858 run iperf3-srv_10.42.42.10(pid=9686): Terminated {rc=256} 12:51:19.990740 --- ParallelTerminationStrategy: PID 9689 died... 12:51:20.009827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9689): Terminated: ok {rc=0} 12:51:20.055204 --- ParallelTerminationStrategy: PID 9692 died... 12:51:20.074603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9692): Terminated: ok {rc=0} 12:51:20.120273 --- ParallelTerminationStrategy: PID 9695 died... 12:51:20.139400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9695): Terminated: ok {rc=0} 12:51:20.227480 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:51:21.378137 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:21.389962 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:51:21.447679 tst iperf3m4.py: using LAC 28516 12:51:21.575483 tst iperf3m4.py: using RAC 211 12:51:21.702195 tst iperf3m4.py: using CellId 28516 12:51:21.829458 tst iperf3m4.py: using BVCI 28517 12:51:21.947717 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:21.958747 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:21.969517 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:21.980552 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:21.991412 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:22.002419 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:22.013572 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:22.024466 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:22.035595 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:51:22.160146 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:51:22.282512 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:51:22.400203 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:51:22.517611 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:51:22.732023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:51:23.052130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9697): Launched 12:51:23.332682 run iperf3-srv_10.42.42.10(pid=9698): Launched 12:51:23.453380 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:51:23.666434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:51:23.986271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9699): Launched 12:51:24.264871 run iperf3-srv_10.42.42.10(pid=9700): Launched 12:51:24.384272 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:51:24.598199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:51:24.918636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9701): Launched 12:51:25.196666 run iperf3-srv_10.42.42.10(pid=9702): Launched 12:51:25.318791 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:51:25.531489 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:51:25.852363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9703): Launched 12:51:26.130880 run iperf3-srv_10.42.42.10(pid=9704): Launched 12:51:26.252488 tst iperf3m4.py:8: start network... 12:51:26.465817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:26.961970 run create_hlr_db(pid=9705): Launched 12:51:27.084461 bus /gobi_6: Setting Powered False 12:51:28.146789 run create_hlr_db(pid=9705): Terminated: ok {rc=0} 12:51:28.611695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9707): Launched 12:51:28.954489 run osmo-hlr_10.42.42.2(pid=9708): Launched 12:51:29.085212 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:29.677352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9710): Launched 12:51:30.020024 run osmo-stp_10.42.42.5(pid=9711): Launched 12:51:30.150924 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:51:30.739590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9713): Launched 12:51:30.893511 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:51:31.175541 run patchelf(pid=9714): Launched 12:51:31.380028 run osmo-stp_10.42.42.5(pid=9711): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9711)] 12:51:31.525930 run osmo-stp_10.42.42.5(pid=9711): stdout: | (launched: 2022-12-10_12:51:29.956185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:31.678433 run osmo-stp_10.42.42.5(pid=9711): stderr: | [0;m[38;5;43m20221210125130153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125130153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125130153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125130154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125130156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125130156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125130156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:31.826251 run osmo-stp_10.42.42.5(pid=9711): stdout: | (launched: 2022-12-10_12:51:29.956185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:31.968885 run osmo-stp_10.42.42.5(pid=9711): stderr: | [0;m[38;5;43m20221210125130153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125130153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125130153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125130154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125130156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125130156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125130156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:32.137903 run patchelf(pid=9714): Terminating (SIGINT) 12:51:32.328204 run patchelf(pid=9714): Terminated: ok {rc=0} 12:51:32.464608 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9711): Process ended prematurely: osmo-stp_10.42.42.5(pid=9711) [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9711)] [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:51:32.474911 tst iperf3m4.py:8: Test FAILED (11.1 sec) 12:51:32.504701 run osmo-hlr_10.42.42.2(pid=9708): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9708)] 12:51:32.555662 run osmo-hlr_10.42.42.2(pid=9708): stdout: | (launched: 2022-12-10_12:51:28.890762) 12:51:32.608316 run osmo-hlr_10.42.42.2(pid=9708): stderr: | [0;m[1;31m20221210125129093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125129093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125129093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125129093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125129093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125129093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125129106 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125129114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125129115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125129115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:32.661429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9697): Terminating (SIGTERM) 12:51:32.703863 run iperf3-srv_10.42.42.10(pid=9698): Terminating (SIGTERM) 12:51:32.746420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9699): Terminating (SIGTERM) 12:51:32.788942 run iperf3-srv_10.42.42.10(pid=9700): Terminating (SIGTERM) 12:51:32.831387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9701): Terminating (SIGTERM) 12:51:32.873813 run iperf3-srv_10.42.42.10(pid=9702): Terminating (SIGTERM) 12:51:32.916070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9703): Terminating (SIGTERM) 12:51:32.958504 run iperf3-srv_10.42.42.10(pid=9704): Terminating (SIGTERM) 12:51:33.000878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9707): Terminating (SIGTERM) 12:51:33.043468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9710): Terminating (SIGTERM) 12:51:33.085871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9713): Terminating (SIGTERM) 12:51:33.128644 --- ParallelTerminationStrategy: PID 9697 died... 12:51:33.149088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9697): Terminated: ok {rc=0} 12:51:33.195894 --- ParallelTerminationStrategy: PID 9698 died... 12:51:33.215656 run iperf3-srv_10.42.42.10(pid=9698): Terminated {rc=256} 12:51:33.262165 --- ParallelTerminationStrategy: PID 9699 died... 12:51:33.282022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9699): Terminated: ok {rc=0} 12:51:33.328817 --- ParallelTerminationStrategy: PID 9700 died... 12:51:33.349071 run iperf3-srv_10.42.42.10(pid=9700): Terminated {rc=256} 12:51:33.396110 --- ParallelTerminationStrategy: PID 9701 died... 12:51:33.415938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9701): Terminated: ok {rc=0} 12:51:33.462865 --- ParallelTerminationStrategy: PID 9702 died... 12:51:33.483092 run iperf3-srv_10.42.42.10(pid=9702): Terminated {rc=256} 12:51:33.529973 --- ParallelTerminationStrategy: PID 9703 died... 12:51:33.549910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9703): Terminated: ok {rc=0} 12:51:33.596723 --- ParallelTerminationStrategy: PID 9704 died... 12:51:33.616644 run iperf3-srv_10.42.42.10(pid=9704): Terminated {rc=256} 12:51:33.663485 --- ParallelTerminationStrategy: PID 9707 died... 12:51:33.683472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9707): Terminated: ok {rc=0} 12:51:33.730230 --- ParallelTerminationStrategy: PID 9710 died... 12:51:33.750216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9710): Terminated: ok {rc=0} 12:51:33.796823 --- ParallelTerminationStrategy: PID 9713 died... 12:51:33.817214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9713): Terminated: ok {rc=0} 12:51:33.906612 bus /gobi_4: Setting Powered False 12:51:35.007329 bus /gobi_4: Setting Powered False 12:51:36.125087 bus /gobi_1: Setting Powered False 12:51:37.225793 bus /gobi_1: Setting Powered False 12:51:38.342732 bus /gobi_0: Setting Powered False 12:51:39.443144 bus /gobi_0: Setting Powered False 12:51:40.560587 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:51:41.666045 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:41.678113 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:51:41.737393 tst ping.py: using LAC 28517 12:51:41.861032 tst ping.py: using RAC 212 12:51:41.982248 tst ping.py: using CellId 28517 12:51:42.102706 tst ping.py: using BVCI 28518 12:51:42.218329 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:42.229539 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:42.240213 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:42.251422 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:42.262391 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:42.273611 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:42.284646 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:42.295672 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:51:42.415991 tst ping.py:19: start network... 12:51:42.641162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:43.156690 run create_hlr_db(pid=9715): Launched 12:51:43.284181 bus /gobi_6: Setting Powered False 12:51:44.350395 run create_hlr_db(pid=9715): Terminated: ok {rc=0} 12:51:44.797632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9717): Launched 12:51:45.115010 run osmo-hlr_10.42.42.2(pid=9718): Launched 12:51:45.245966 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:45.803879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9720): Launched 12:51:46.146464 run osmo-stp_10.42.42.5(pid=9721): Launched 12:51:46.430809 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:51:46.976810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9723): Launched 12:51:47.114934 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:51:47.402899 run patchelf(pid=9724): Launched 12:51:47.589327 run osmo-stp_10.42.42.5(pid=9721): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9721)] 12:51:47.730335 run osmo-stp_10.42.42.5(pid=9721): stdout: | (launched: 2022-12-10_12:51:46.083955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:47.872818 run osmo-stp_10.42.42.5(pid=9721): stderr: | [0;m[38;5;43m20221210125146282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125146282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125146283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125146283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125146286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125146286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125146287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:48.015212 run osmo-stp_10.42.42.5(pid=9721): stdout: | (launched: 2022-12-10_12:51:46.083955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:48.152128 run osmo-stp_10.42.42.5(pid=9721): stderr: | [0;m[38;5;43m20221210125146282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125146282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125146283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125146283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125146286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125146286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125146287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:48.314224 run patchelf(pid=9724): Terminating (SIGINT) 12:51:48.501670 run patchelf(pid=9724): Terminated: ok {rc=0} 12:51:48.636079 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9721): Process ended prematurely: osmo-stp_10.42.42.5(pid=9721) [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9721)] [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 12:51:48.645834 tst ping.py:22: Test FAILED (7.0 sec) 12:51:48.674494 run osmo-hlr_10.42.42.2(pid=9718): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9718)] 12:51:48.725554 run osmo-hlr_10.42.42.2(pid=9718): stdout: | (launched: 2022-12-10_12:51:45.055377) 12:51:48.778241 run osmo-hlr_10.42.42.2(pid=9718): stderr: | [0;m[1;31m20221210125145248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125145248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125145248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125145248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125145248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125145248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125145260 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125145270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125145270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125145270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:48.831545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9717): Terminating (SIGTERM) 12:51:48.874182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9720): Terminating (SIGTERM) 12:51:48.916658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9723): Terminating (SIGTERM) 12:51:48.959370 --- ParallelTerminationStrategy: PID 9717 died... 12:51:48.979702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9717): Terminated: ok {rc=0} 12:51:49.026520 --- ParallelTerminationStrategy: PID 9720 died... 12:51:49.046383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9720): Terminated: ok {rc=0} 12:51:49.093368 --- ParallelTerminationStrategy: PID 9723 died... 12:51:49.113282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9723): Terminated: ok {rc=0} 12:51:49.201876 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:51:50.291015 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:50.303140 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:51:50.362442 tst ping_idle_ping.py: using LAC 28518 12:51:50.493912 tst ping_idle_ping.py: using RAC 213 12:51:50.624214 tst ping_idle_ping.py: using CellId 28518 12:51:50.755342 tst ping_idle_ping.py: using BVCI 28519 12:51:50.878104 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:50.889608 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:50.900616 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:50.911840 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:50.923007 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:50.934238 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:50.945598 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:51:50.956767 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:51:51.078536 tst ping_idle_ping.py:24: start network... 12:51:51.303157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:51.824183 run create_hlr_db(pid=9725): Launched 12:51:51.958970 bus /gobi_6: Setting Powered False 12:51:53.024262 run create_hlr_db(pid=9725): Terminated: ok {rc=0} 12:51:53.471874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9727): Launched 12:51:53.789231 run osmo-hlr_10.42.42.2(pid=9728): Launched 12:51:53.910243 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:54.467763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9730): Launched 12:51:54.784745 run osmo-stp_10.42.42.5(pid=9731): Launched 12:51:54.905354 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:51:55.447454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9733): Launched 12:51:55.568777 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:51:55.835844 run patchelf(pid=9734): Launched 12:51:56.012646 run osmo-stp_10.42.42.5(pid=9731): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9731)] 12:51:56.145943 run osmo-stp_10.42.42.5(pid=9731): stdout: | (launched: 2022-12-10_12:51:54.725336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:56.280515 run osmo-stp_10.42.42.5(pid=9731): stderr: | [0;m[38;5;43m20221210125154901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125154901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125154901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125154901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125154902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125154902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125154902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:56.415747 run osmo-stp_10.42.42.5(pid=9731): stdout: | (launched: 2022-12-10_12:51:54.725336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:56.545262 run osmo-stp_10.42.42.5(pid=9731): stderr: | [0;m[38;5;43m20221210125154901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125154901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125154901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125154901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125154902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125154902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125154902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:56.698511 run patchelf(pid=9734): Terminating (SIGINT) 12:51:56.875373 run patchelf(pid=9734): Terminated: ok {rc=0} 12:51:57.002598 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9731): Process ended prematurely: osmo-stp_10.42.42.5(pid=9731) [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9731)] [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:51:57.011544 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:51:57.038978 run osmo-hlr_10.42.42.2(pid=9728): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9728)] 12:51:57.087949 run osmo-hlr_10.42.42.2(pid=9728): stdout: | (launched: 2022-12-10_12:51:53.729594) 12:51:57.138855 run osmo-hlr_10.42.42.2(pid=9728): stderr: | [0;m[1;31m20221210125153911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125153911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125153911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125153911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125153911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125153911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125153923 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125153934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125153934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125153935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:57.189972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9727): Terminating (SIGTERM) 12:51:57.230880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9730): Terminating (SIGTERM) 12:51:57.271707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9733): Terminating (SIGTERM) 12:51:57.312868 --- ParallelTerminationStrategy: PID 9727 died... 12:51:57.332409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9727): Terminated: ok {rc=0} 12:51:57.378103 --- ParallelTerminationStrategy: PID 9730 died... 12:51:57.397168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9730): Terminated: ok {rc=0} 12:51:57.442891 --- ParallelTerminationStrategy: PID 9733 died... 12:51:57.462032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9733): Terminated: ok {rc=0} 12:51:57.548353 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:51:58.843862 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:51:58.851516 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:51:58.873067 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:51:58.908282 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:51:58.963125 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:51:58.985591 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:51:59.021074 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:51:59.576904 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:51:59.582521 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:51:59.594410 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:51:59.652380 tst switch_tch_pdch.py: using LAC 28519 12:51:59.778160 tst switch_tch_pdch.py: using RAC 214 12:51:59.901751 tst switch_tch_pdch.py: using CellId 28519 12:52:00.025634 tst switch_tch_pdch.py: using BVCI 28520 12:52:00.148717 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:52:00.160561 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:52:00.172213 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:52:00.183958 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:52:00.195313 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:52:00.207175 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:52:00.218839 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:52:00.230307 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:52:00.348816 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:52:00.469372 tst switch_tch_pdch.py:51: start network... 12:52:00.678344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:01.219322 run create_hlr_db(pid=9739): Launched 12:52:01.364522 bus /gobi_6: Setting Powered False 12:52:02.430263 run create_hlr_db(pid=9739): Terminated: ok {rc=0} 12:52:02.877625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9741): Launched 12:52:03.191840 run osmo-hlr_10.42.42.2(pid=9742): Launched 12:52:03.312054 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:03.863149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9744): Launched 12:52:04.177464 run osmo-stp_10.42.42.5(pid=9745): Launched 12:52:04.297975 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:52:04.838735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9747): Launched 12:52:04.959311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:52:05.223475 run patchelf(pid=9748): Launched 12:52:05.397715 run osmo-stp_10.42.42.5(pid=9745): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9745)] 12:52:05.529516 run osmo-stp_10.42.42.5(pid=9745): stdout: | (launched: 2022-12-10_12:52:04.118093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:05.662437 run osmo-stp_10.42.42.5(pid=9745): stderr: | [0;m[38;5;43m20221210125204291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125204291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125204291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125204292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125204294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125204294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125204294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:05.795317 run osmo-stp_10.42.42.5(pid=9745): stdout: | (launched: 2022-12-10_12:52:04.118093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:05.923083 run osmo-stp_10.42.42.5(pid=9745): stderr: | [0;m[38;5;43m20221210125204291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125204291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125204291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125204292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125204294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125204294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125204294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:06.074637 run patchelf(pid=9748): Terminating (SIGINT) 12:52:06.250635 run patchelf(pid=9748): Terminated: ok {rc=0} 12:52:06.377456 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9745): Process ended prematurely: osmo-stp_10.42.42.5(pid=9745) [trial-2375↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9745)] [trial-2375↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:52:06.386392 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 12:52:06.413865 run osmo-hlr_10.42.42.2(pid=9742): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9742)] 12:52:06.462757 run osmo-hlr_10.42.42.2(pid=9742): stdout: | (launched: 2022-12-10_12:52:03.132420) 12:52:06.513152 run osmo-hlr_10.42.42.2(pid=9742): stderr: | [0;m[1;31m20221210125203313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125203313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125203313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125203313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125203313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125203313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125203327 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125203336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125203337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125203337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:06.563556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9741): Terminating (SIGTERM) 12:52:06.603880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9744): Terminating (SIGTERM) 12:52:06.644339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9747): Terminating (SIGTERM) 12:52:06.684902 --- ParallelTerminationStrategy: PID 9741 died... 12:52:06.704369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9741): Terminated: ok {rc=0} 12:52:06.749524 --- ParallelTerminationStrategy: PID 9744 died... 12:52:06.768250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9744): Terminated: ok {rc=0} 12:52:06.813843 --- ParallelTerminationStrategy: PID 9747 died... 12:52:06.832827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9747): Terminated: ok {rc=0} 12:52:06.919895 bus /gobi_0: Setting Powered False 12:52:08.020184 bus /gobi_0: Setting Powered False 12:52:09.136551 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:52:10.371335 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:10.377122 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:52:10.398192 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:52:10.432832 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:52:10.485559 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:52:10.506153 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:52:10.540834 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:52:11.098108 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:52:11.103586 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:52:11.115199 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:52:11.176287 tst switch_tch_pdch.py: using LAC 28520 12:52:11.306608 tst switch_tch_pdch.py: using RAC 215 12:52:11.436665 tst switch_tch_pdch.py: using CellId 28520 12:52:11.565613 tst switch_tch_pdch.py: using BVCI 28521 12:52:11.688462 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:52:11.700370 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:52:11.711640 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:52:11.722851 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:52:11.733960 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:52:11.745107 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:52:11.756702 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:52:11.767867 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:52:11.886274 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:52:12.003744 tst switch_tch_pdch.py:51: start network... 12:52:12.212284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:12.669951 run create_hlr_db(pid=9753): Launched 12:52:12.808432 bus /gobi_6: Setting Powered False 12:52:13.874274 run create_hlr_db(pid=9753): Terminated: ok {rc=0} 12:52:14.293207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9755): Launched 12:52:14.608049 run osmo-hlr_10.42.42.2(pid=9756): Launched 12:52:14.730082 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:15.254291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9758): Launched 12:52:15.568189 run osmo-stp_10.42.42.5(pid=9759): Launched 12:52:15.689576 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:52:16.268614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9761): Launched 12:52:16.425957 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:52:16.698323 run patchelf(pid=9762): Launched 12:52:16.885125 run osmo-stp_10.42.42.5(pid=9759): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9759)] 12:52:17.019949 run osmo-stp_10.42.42.5(pid=9759): stdout: | (launched: 2022-12-10_12:52:15.509201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:17.156616 run osmo-stp_10.42.42.5(pid=9759): stderr: | [0;m[38;5;43m20221210125215682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125215682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125215682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125215683 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125215683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125215683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125215683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:17.292195 run osmo-stp_10.42.42.5(pid=9759): stdout: | (launched: 2022-12-10_12:52:15.509201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:17.420208 run osmo-stp_10.42.42.5(pid=9759): stderr: | [0;m[38;5;43m20221210125215682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125215682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125215682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125215683 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125215683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125215683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125215683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:17.572079 run patchelf(pid=9762): Terminating (SIGINT) 12:52:17.747717 run patchelf(pid=9762): Terminated: ok {rc=0} 12:52:17.873754 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9759): Process ended prematurely: osmo-stp_10.42.42.5(pid=9759) [trial-2375↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9759)] [trial-2375↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:52:17.882867 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 12:52:17.910261 run osmo-hlr_10.42.42.2(pid=9756): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9756)] 12:52:17.959213 run osmo-hlr_10.42.42.2(pid=9756): stdout: | (launched: 2022-12-10_12:52:14.549144) 12:52:18.010007 run osmo-hlr_10.42.42.2(pid=9756): stderr: | [0;m[1;31m20221210125214728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125214728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125214728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125214728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125214728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125214728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125214741 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125214749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125214749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125214749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:18.060673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9755): Terminating (SIGTERM) 12:52:18.101427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9758): Terminating (SIGTERM) 12:52:18.141995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9761): Terminating (SIGTERM) 12:52:18.182966 --- ParallelTerminationStrategy: PID 9755 died... 12:52:18.202354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9755): Terminated: ok {rc=0} 12:52:18.247394 --- ParallelTerminationStrategy: PID 9758 died... 12:52:18.266322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9758): Terminated: ok {rc=0} 12:52:18.311704 --- ParallelTerminationStrategy: PID 9761 died... 12:52:18.330759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9761): Terminated: ok {rc=0} 12:52:18.415987 bus /gobi_0: Setting Powered False 12:52:19.515587 bus /gobi_0: Setting Powered False 12:52:20.632155 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_sms:oc2g --------------------------------------------------------------------- 12:52:21.872585 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:21.877050 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 12:52:21.898288 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 12:52:21.905278 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 12:52:21.962552 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 12:52:21.983946 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 12:52:21.990860 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 12:52:22.523700 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 12:52:22.529057 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 12:52:22.539788 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 12:52:22.574750 tst mo_mt_sms.py: using LAC 28521 12:52:22.701210 tst mo_mt_sms.py: using RAC 216 12:52:22.831169 tst mo_mt_sms.py: using CellId 28521 12:52:22.959964 tst mo_mt_sms.py: using BVCI 28522 12:52:23.080681 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 12:52:23.203097 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 12:52:23.320129 tst mo_mt_sms.py:9: start nitb and bts... 12:52:23.530097 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:52:24.166123 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9766): Launched 12:52:24.483925 run osmo-nitb_10.42.42.2(pid=9767): Launched 12:52:24.659570 run osmo-nitb_10.42.42.2(pid=9767): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9767)] 12:52:24.799934 run osmo-nitb_10.42.42.2(pid=9767): stdout: | (launched: 2022-12-10_12:52:24.424624) 12:52:24.941240 run osmo-nitb_10.42.42.2(pid=9767): stderr: | (launched: 2022-12-10_12:52:24.471258) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:52:25.082261 run osmo-nitb_10.42.42.2(pid=9767): stdout: | (launched: 2022-12-10_12:52:24.424624) 12:52:25.218591 run osmo-nitb_10.42.42.2(pid=9767): stderr: | (launched: 2022-12-10_12:52:24.471258) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9767): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9767) [trial-2375↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9767)] 12:52:25.604605 tst osmo-nitb_10.42.42.2(pid=9767): stdout: | (launched: 2022-12-10_12:52:24.424624) 12:52:25.730075 tst osmo-nitb_10.42.42.2(pid=9767): stderr: | (launched: 2022-12-10_12:52:24.471258) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:52:25.878099 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9767): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9767) [trial-2375↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9767)] [trial-2375↪nitb_sms:oc2g↪mo_mt_sms.py:11] 12:52:25.886736 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 12:52:25.893367 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9766): Terminating (SIGTERM) 12:52:26.103427 --- ParallelTerminationStrategy: PID 9766 died... 12:52:26.124602 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9766): Terminated: ok {rc=0} 12:52:26.212579 bus /sierra_3: Setting Powered False 12:52:27.313821 bus /sierra_3: Setting Powered False 12:52:28.432342 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 sms:oc2g --------------------------------------------------------------------- 12:52:29.612842 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:29.617079 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 12:52:29.638368 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 12:52:29.665850 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 12:52:29.719738 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 12:52:29.740540 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 12:52:29.767719 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 12:52:30.310137 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 sms:oc2g mo_mt_sms.py ---------------------------------------------- 12:52:30.315350 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 12:52:30.326017 tst sms:oc2g: Using 1 x bts (candidates: 1) 12:52:30.360449 tst mo_mt_sms.py: using LAC 28522 12:52:30.490807 tst mo_mt_sms.py: using RAC 217 12:52:30.621692 tst mo_mt_sms.py: using CellId 28522 12:52:30.751868 tst mo_mt_sms.py: using BVCI 28523 12:52:30.884748 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 12:52:30.898365 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 12:52:30.922521 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 12:52:30.934731 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 12:52:30.946578 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 12:52:30.958930 tst sms:oc2g: Using 1 x modem (candidates: 2) 12:52:31.088814 tst sms:oc2g: Using 1 x modem (candidates: 2) 12:52:31.236454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:31.815369 run create_hlr_db(pid=9771): Launched 12:52:31.983827 bus /sierra_2: Setting Powered False 12:52:33.050072 run create_hlr_db(pid=9771): Terminated: ok {rc=0} 12:52:33.494407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9773): Launched 12:52:33.809039 run osmo-hlr_10.42.42.2(pid=9774): Launched 12:52:33.928507 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:34.483843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9776): Launched 12:52:34.799358 run osmo-stp_10.42.42.5(pid=9777): Launched 12:52:34.919982 run osmo-msc_10.42.42.6: Starting osmo-msc 12:52:35.485453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9779): Launched 12:52:35.800910 run osmo-msc_10.42.42.6(pid=9780): Launched 12:52:35.978319 run osmo-stp_10.42.42.5(pid=9777): ERR: Terminated: ERROR {rc=1} [trial-2375↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9777)] 12:52:36.114173 run osmo-stp_10.42.42.5(pid=9777): stdout: | (launched: 2022-12-10_12:52:34.740086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:36.245802 run osmo-stp_10.42.42.5(pid=9777): stderr: | [0;m[38;5;43m20221210125234914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125234914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125234914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125234915 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125234915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125234915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125234915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:36.375673 run osmo-stp_10.42.42.5(pid=9777): stdout: | (launched: 2022-12-10_12:52:34.740086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:36.499288 run osmo-stp_10.42.42.5(pid=9777): stderr: | [0;m[38;5;43m20221210125234914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125234914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125234914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125234915 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125234915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125234915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125234915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:36.647747 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9777): Process ended prematurely: osmo-stp_10.42.42.5(pid=9777) [trial-2375↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9777)] [trial-2375↪sms:oc2g↪mo_mt_sms.py:16] 12:52:36.656256 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 12:52:36.683406 run osmo-hlr_10.42.42.2(pid=9774): ERR: Terminated: ERROR {rc=237} [trial-2375↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9774)] 12:52:36.732499 run osmo-hlr_10.42.42.2(pid=9774): stdout: | (launched: 2022-12-10_12:52:33.749915) 12:52:36.782807 run osmo-hlr_10.42.42.2(pid=9774): stderr: | [0;m[1;31m20221210125233928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125233928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125233928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125233928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125233929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125233929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125233940 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125233948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125233949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125233949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:36.853384 run osmo-msc_10.42.42.6(pid=9780): ERR: Terminated: ERROR {rc=2} [trial-2375↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9780)] 12:52:36.901981 run osmo-msc_10.42.42.6(pid=9780): stdout: | (launched: 2022-12-10_12:52:35.741752) 12:52:36.952286 run osmo-msc_10.42.42.6(pid=9780): stderr: | [0;m[38;5;43m20221210125236020 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125236020 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7c4db68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125236020 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125236020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125236021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125236021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125236023 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125236023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125236023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125236023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:52:37.002689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9773): Terminating (SIGTERM) 12:52:37.043110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9776): Terminating (SIGTERM) 12:52:37.083743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9779): Terminating (SIGTERM) 12:52:37.125173 --- ParallelTerminationStrategy: PID 9773 died... 12:52:37.144435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9773): Terminated: ok {rc=0} 12:52:37.189520 --- ParallelTerminationStrategy: PID 9776 died... 12:52:37.208334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9776): Terminated: ok {rc=0} 12:52:37.254039 --- ParallelTerminationStrategy: PID 9779 died... 12:52:37.272936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9779): Terminated: ok {rc=0} 12:52:37.359272 bus /sierra_3: Setting Powered False 12:52:38.458491 bus /sierra_3: Setting Powered False 12:52:39.578531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_ussd:oc2g --------------------------------------------------------------------- 12:52:40.790847 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:40.794533 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 12:52:40.814857 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 12:52:40.822740 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 12:52:40.863530 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 12:52:40.885934 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 12:52:40.893045 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 12:52:41.406002 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2375 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 12:52:41.410844 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 12:52:41.421758 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 12:52:41.455322 tst assert_extension.py: using LAC 28523 12:52:41.577119 tst assert_extension.py: using RAC 218 12:52:41.698250 tst assert_extension.py: using CellId 28523 12:52:41.820637 tst assert_extension.py: using BVCI 28524 12:52:41.934311 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 12:52:42.055272 tst assert_extension.py:10: start nitb and bts... 12:52:42.280453 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:52:42.971772 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9785): Launched 12:52:43.295975 run osmo-nitb_10.42.42.2(pid=9786): Launched 12:52:43.475981 run osmo-nitb_10.42.42.2(pid=9786): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9786)] 12:52:43.620064 run osmo-nitb_10.42.42.2(pid=9786): stdout: | (launched: 2022-12-10_12:52:43.235753) 12:52:43.764533 run osmo-nitb_10.42.42.2(pid=9786): stderr: | (launched: 2022-12-10_12:52:43.283470) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:52:43.909063 run osmo-nitb_10.42.42.2(pid=9786): stdout: | (launched: 2022-12-10_12:52:43.235753) 12:52:44.047948 run osmo-nitb_10.42.42.2(pid=9786): stderr: | (launched: 2022-12-10_12:52:43.283470) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9786): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9786) [trial-2375↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9786)] 12:52:44.419518 tst osmo-nitb_10.42.42.2(pid=9786): stdout: | (launched: 2022-12-10_12:52:43.235753) 12:52:44.540709 tst osmo-nitb_10.42.42.2(pid=9786): stderr: | (launched: 2022-12-10_12:52:43.283470) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:52:44.682901 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9786): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9786) [trial-2375↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9786)] [trial-2375↪nitb_ussd:oc2g↪assert_extension.py:12] 12:52:44.691095 tst assert_extension.py:12: Test FAILED (3.3 sec) 12:52:44.697743 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9785): Terminating (SIGTERM) 12:52:44.906238 --- ParallelTerminationStrategy: PID 9785 died... 12:52:44.927062 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9785): Terminated: ok {rc=0} 12:52:45.010616 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 ussd:oc2g --------------------------------------------------------------------- 12:52:46.179434 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:46.185226 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 12:52:46.213031 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 12:52:46.247922 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 12:52:46.290005 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 12:52:46.314326 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 12:52:46.349318 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 12:52:46.864608 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2375 ussd:oc2g assert_extension.py ---------------------------------------------- 12:52:46.871814 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 12:52:46.887146 tst ussd:oc2g: Using 1 x bts (candidates: 1) 12:52:46.929439 tst assert_extension.py: using LAC 28524 12:52:47.091555 tst assert_extension.py: using RAC 219 12:52:47.216438 tst assert_extension.py: using CellId 28524 12:52:47.341609 tst assert_extension.py: using BVCI 28525 12:52:47.459017 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 12:52:47.470092 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 12:52:47.480833 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 12:52:47.491970 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 12:52:47.503136 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 12:52:47.514020 tst ussd:oc2g: Using 1 x modem (candidates: 1) 12:52:47.627405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:48.092820 run create_hlr_db(pid=9792): Launched 12:52:48.208486 bus /sierra_2: Setting Powered False 12:52:49.268529 run create_hlr_db(pid=9792): Terminated: ok {rc=0} 12:52:49.687156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9794): Launched 12:52:49.987812 run osmo-hlr_10.42.42.2(pid=9795): Launched 12:52:50.102635 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:50.622471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9797): Launched 12:52:50.924336 run osmo-stp_10.42.42.5(pid=9798): Launched 12:52:51.038559 run osmo-msc_10.42.42.6: Starting osmo-msc 12:52:51.578876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9800): Launched 12:52:51.879703 run osmo-msc_10.42.42.6(pid=9801): Launched 12:52:52.047013 run osmo-stp_10.42.42.5(pid=9798): ERR: Terminated: ERROR {rc=1} [trial-2375↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9798)] 12:52:52.175297 run osmo-stp_10.42.42.5(pid=9798): stdout: | (launched: 2022-12-10_12:52:50.867549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:52.302490 run osmo-stp_10.42.42.5(pid=9798): stderr: | [0;m[38;5;43m20221210125251039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125251039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125251040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125251040 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125251040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125251041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125251041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:52.427412 run osmo-stp_10.42.42.5(pid=9798): stdout: | (launched: 2022-12-10_12:52:50.867549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:52.546615 run osmo-stp_10.42.42.5(pid=9798): stderr: | [0;m[38;5;43m20221210125251039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125251039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125251040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125251040 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125251040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125251041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125251041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:52.689288 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9798): Process ended prematurely: osmo-stp_10.42.42.5(pid=9798) [trial-2375↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9798)] [trial-2375↪ussd:oc2g↪assert_extension.py:17] 12:52:52.697322 tst assert_extension.py:17: Test FAILED (5.8 sec) 12:52:52.724009 run osmo-hlr_10.42.42.2(pid=9795): ERR: Terminated: ERROR {rc=237} [trial-2375↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9795)] 12:52:52.771490 run osmo-hlr_10.42.42.2(pid=9795): stdout: | (launched: 2022-12-10_12:52:49.930702) 12:52:52.820788 run osmo-hlr_10.42.42.2(pid=9795): stderr: | [0;m[1;31m20221210125250109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125250109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125250109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125250109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125250109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125250109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125250125 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125250134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125250135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125250135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:52.889303 run osmo-msc_10.42.42.6(pid=9801): ERR: Terminated: ERROR {rc=2} [trial-2375↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9801)] 12:52:52.936890 run osmo-msc_10.42.42.6(pid=9801): stdout: | (launched: 2022-12-10_12:52:51.822756) 12:52:52.985935 run osmo-msc_10.42.42.6(pid=9801): stderr: | [0;m[38;5;43m20221210125252097 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125252098 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6e5d118c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125252098 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125252098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125252098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125252098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125252100 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125252100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125252101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125252101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:52:53.035382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9794): Terminating (SIGTERM) 12:52:53.074791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9797): Terminating (SIGTERM) 12:52:53.114039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9800): Terminating (SIGTERM) 12:52:53.153549 --- ParallelTerminationStrategy: PID 9794 died... 12:52:53.172403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9794): Terminated: ok {rc=0} 12:52:53.216155 --- ParallelTerminationStrategy: PID 9797 died... 12:52:53.234530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9797): Terminated: ok {rc=0} 12:52:53.278020 --- ParallelTerminationStrategy: PID 9800 died... 12:52:53.296111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9800): Terminated: ok {rc=0} 12:52:53.379582 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:52:54.586438 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:54.595292 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:52:54.618062 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:52:54.645652 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:52:54.706194 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:52:54.727231 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:52:54.755424 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:52:55.296853 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:52:55.350387 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:52:55.362103 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:52:55.421123 tst mo_mt_call.py: using LAC 28525 12:52:55.551509 tst mo_mt_call.py: using RAC 220 12:52:55.682339 tst mo_mt_call.py: using CellId 28525 12:52:55.810357 tst mo_mt_call.py: using BVCI 28526 12:52:55.930734 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:52:55.942150 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:52:55.953198 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:52:55.964208 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:52:55.975387 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:52:55.986583 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:52:56.103150 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:52:56.220245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:56.697207 run create_hlr_db(pid=9806): Launched 12:52:56.814847 bus /sierra_2: Setting Powered False 12:52:57.875758 run create_hlr_db(pid=9806): Terminated: ok {rc=0} 12:52:58.323460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9808): Launched 12:52:58.652757 run osmo-hlr_10.42.42.2(pid=9809): Launched 12:52:58.779196 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:59.321569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9811): Launched 12:52:59.629650 run osmo-stp_10.42.42.5(pid=9812): Launched 12:52:59.746364 run osmo-msc_10.42.42.6: Starting osmo-msc 12:53:00.299301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9814): Launched 12:53:00.607501 run osmo-msc_10.42.42.6(pid=9815): Launched 12:53:00.779394 run osmo-stp_10.42.42.5(pid=9812): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9812)] 12:53:01.018346 run osmo-stp_10.42.42.5(pid=9812): stdout: | (launched: 2022-12-10_12:52:59.571678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:01.154858 run osmo-stp_10.42.42.5(pid=9812): stderr: | [0;m[38;5;43m20221210125259746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125259747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125259747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125259747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125259748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125259748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125259748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:01.286771 run osmo-stp_10.42.42.5(pid=9812): stdout: | (launched: 2022-12-10_12:52:59.571678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:01.413287 run osmo-stp_10.42.42.5(pid=9812): stderr: | [0;m[38;5;43m20221210125259746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125259747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125259747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125259747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125259748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125259748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125259748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:01.565928 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9812): Process ended prematurely: osmo-stp_10.42.42.5(pid=9812) [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9812)] [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:53:01.575869 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:53:01.606113 run osmo-hlr_10.42.42.2(pid=9809): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9809)] 12:53:01.656555 run osmo-hlr_10.42.42.2(pid=9809): stdout: | (launched: 2022-12-10_12:52:58.591439) 12:53:01.708486 run osmo-hlr_10.42.42.2(pid=9809): stderr: | [0;m[1;31m20221210125258795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125258795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125258795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125258795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125258795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125258795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125258808 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125258816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125258816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125258816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:01.780399 run osmo-msc_10.42.42.6(pid=9815): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9815)] 12:53:01.830996 run osmo-msc_10.42.42.6(pid=9815): stdout: | (launched: 2022-12-10_12:53:00.549096) 12:53:01.883032 run osmo-msc_10.42.42.6(pid=9815): stderr: | [0;m[38;5;43m20221210125300824 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125300824 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f59e6c50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125300824 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125300824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125300825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125300825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125300827 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125300827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125300827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125300827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:53:01.935655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9808): Terminating (SIGTERM) 12:53:01.978522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9811): Terminating (SIGTERM) 12:53:02.022444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9814): Terminating (SIGTERM) 12:53:02.065455 --- ParallelTerminationStrategy: PID 9808 died... 12:53:02.085161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9808): Terminated: ok {rc=0} 12:53:02.132707 --- ParallelTerminationStrategy: PID 9811 died... 12:53:02.152319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9811): Terminated: ok {rc=0} 12:53:02.198917 --- ParallelTerminationStrategy: PID 9814 died... 12:53:02.218601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9814): Terminated: ok {rc=0} 12:53:02.307711 bus /sierra_3: Setting Powered False 12:53:03.406546 bus /sierra_3: Setting Powered False 12:53:04.521511 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:53:05.667498 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:53:05.679055 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:53:05.735171 tst mo_mt_call_osmux.py: using LAC 28526 12:53:05.858209 tst mo_mt_call_osmux.py: using RAC 221 12:53:05.980654 tst mo_mt_call_osmux.py: using CellId 28526 12:53:06.103607 tst mo_mt_call_osmux.py: using BVCI 28527 12:53:06.216588 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:53:06.227630 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:53:06.238432 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:53:06.249520 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:53:06.260361 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:53:06.271622 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:53:06.387202 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:53:06.508656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:07.019007 run create_hlr_db(pid=9817): Launched 12:53:07.152248 bus /sierra_2: Setting Powered False 12:53:08.216826 run create_hlr_db(pid=9817): Terminated: ok {rc=0} 12:53:08.651658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9819): Launched 12:53:08.959628 run osmo-hlr_10.42.42.2(pid=9820): Launched 12:53:09.077410 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:09.619683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9822): Launched 12:53:09.927082 run osmo-stp_10.42.42.5(pid=9823): Launched 12:53:10.044617 run osmo-msc_10.42.42.6: Starting osmo-msc 12:53:10.598762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9825): Launched 12:53:10.905302 run osmo-msc_10.42.42.6(pid=9826): Launched 12:53:11.075833 run osmo-stp_10.42.42.5(pid=9823): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9823)] 12:53:11.205472 run osmo-stp_10.42.42.5(pid=9823): stdout: | (launched: 2022-12-10_12:53:09.869094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:11.334517 run osmo-stp_10.42.42.5(pid=9823): stderr: | [0;m[38;5;43m20221210125310039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125310040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125310040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125310040 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125310042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125310043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125310043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:11.461127 run osmo-stp_10.42.42.5(pid=9823): stdout: | (launched: 2022-12-10_12:53:09.869094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:11.581770 run osmo-stp_10.42.42.5(pid=9823): stderr: | [0;m[38;5;43m20221210125310039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125310040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125310040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125310040 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125310042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125310043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125310043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:11.726668 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9823): Process ended prematurely: osmo-stp_10.42.42.5(pid=9823) [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9823)] [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:53:11.735374 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:53:11.761936 run osmo-hlr_10.42.42.2(pid=9820): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9820)] 12:53:11.809415 run osmo-hlr_10.42.42.2(pid=9820): stdout: | (launched: 2022-12-10_12:53:08.901744) 12:53:11.858193 run osmo-hlr_10.42.42.2(pid=9820): stderr: | [0;m[1;31m20221210125309081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125309081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125309081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125309081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125309081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125309081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125309094 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125309102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125309103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125309103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:11.926271 run osmo-msc_10.42.42.6(pid=9826): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9826)] 12:53:11.973423 run osmo-msc_10.42.42.6(pid=9826): stdout: | (launched: 2022-12-10_12:53:10.847316) 12:53:12.022113 run osmo-msc_10.42.42.6(pid=9826): stderr: | [0;m[38;5;43m20221210125311121 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125311121 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f341a4b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125311121 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125311122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125311122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125311122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125311124 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125311124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125311124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125311124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:53:12.071360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9819): Terminating (SIGTERM) 12:53:12.110781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9822): Terminating (SIGTERM) 12:53:12.150014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9825): Terminating (SIGTERM) 12:53:12.189561 --- ParallelTerminationStrategy: PID 9819 died... 12:53:12.208191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9819): Terminated: ok {rc=0} 12:53:12.252219 --- ParallelTerminationStrategy: PID 9822 died... 12:53:12.270537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9822): Terminated: ok {rc=0} 12:53:12.314352 --- ParallelTerminationStrategy: PID 9825 died... 12:53:12.332661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9825): Terminated: ok {rc=0} 12:53:12.417357 bus /sierra_3: Setting Powered False 12:53:13.514475 bus /sierra_3: Setting Powered False 12:53:14.626813 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:53:15.861883 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:53:15.869236 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:53:15.896578 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:53:15.927412 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:53:15.980902 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:53:16.002692 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:53:16.035199 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:53:16.621883 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:53:16.684701 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:53:16.696734 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:53:16.764237 tst mo_mt_call.py: using LAC 28527 12:53:16.938927 tst mo_mt_call.py: using RAC 222 12:53:17.101771 tst mo_mt_call.py: using CellId 28527 12:53:17.251868 tst mo_mt_call.py: using BVCI 28528 12:53:17.400634 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:53:17.418898 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:53:17.437030 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:53:17.453049 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:53:17.469916 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:53:17.488252 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:53:17.639997 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:53:17.788803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:18.427038 run create_hlr_db(pid=9923): Launched 12:53:18.623482 bus /sierra_2: Setting Powered False 12:53:19.685267 run create_hlr_db(pid=9923): Terminated: ok {rc=0} 12:53:20.180499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10104): Launched 12:53:20.513652 run osmo-hlr_10.42.42.2(pid=10105): Launched 12:53:20.763253 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:21.493670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10108): Launched 12:53:21.829631 run osmo-stp_10.42.42.5(pid=10110): Launched 12:53:22.086229 run osmo-msc_10.42.42.6: Starting osmo-msc 12:53:22.810582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10112): Launched 12:53:23.141316 run osmo-msc_10.42.42.6(pid=10113): Launched 12:53:23.490710 run osmo-stp_10.42.42.5(pid=10110): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10110)] 12:53:23.750557 run osmo-stp_10.42.42.5(pid=10110): stdout: | (launched: 2022-12-10_12:53:21.761607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:24.023732 run osmo-stp_10.42.42.5(pid=10110): stderr: | [0;m[38;5;43m20221210125322103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125322103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125322104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125322104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125322104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125322104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125322109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:24.210912 run osmo-stp_10.42.42.5(pid=10110): stdout: | (launched: 2022-12-10_12:53:21.761607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:24.335970 run osmo-stp_10.42.42.5(pid=10110): stderr: | [0;m[38;5;43m20221210125322103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125322103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125322104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125322104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125322104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125322104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125322109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:24.492252 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10110): Process ended prematurely: osmo-stp_10.42.42.5(pid=10110) [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10110)] [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:53:24.502162 tst mo_mt_call.py:8: Test FAILED (7.9 sec) 12:53:24.532814 run osmo-hlr_10.42.42.2(pid=10105): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10105)] 12:53:24.584743 run osmo-hlr_10.42.42.2(pid=10105): stdout: | (launched: 2022-12-10_12:53:20.441763) 12:53:24.637269 run osmo-hlr_10.42.42.2(pid=10105): stderr: | [0;m[1;31m20221210125320789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125320789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125320789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125320789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125320789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125320789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125320810 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125320823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125320823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125320823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:24.715433 run osmo-msc_10.42.42.6(pid=10113): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10113)] 12:53:24.769499 run osmo-msc_10.42.42.6(pid=10113): stdout: | (launched: 2022-12-10_12:53:23.077572) 12:53:24.822024 run osmo-msc_10.42.42.6(pid=10113): stderr: | [0;m[38;5;43m20221210125323681 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125323681 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc93db81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125323681 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125323681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125323682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125323682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125323683 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125323684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125323684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125323684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:53:24.875954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10104): Terminating (SIGTERM) 12:53:24.919038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10108): Terminating (SIGTERM) 12:53:24.969322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10112): Terminating (SIGTERM) 12:53:25.014496 --- ParallelTerminationStrategy: PID 10104 died... 12:53:25.034930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10104): Terminated: ok {rc=0} 12:53:25.084197 --- ParallelTerminationStrategy: PID 10108 died... 12:53:25.104146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10108): Terminated: ok {rc=0} 12:53:25.151920 --- ParallelTerminationStrategy: PID 10112 died... 12:53:25.172844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10112): Terminated: ok {rc=0} 12:53:25.269782 bus /sierra_3: Setting Powered False 12:53:26.373445 bus /sierra_3: Setting Powered False 12:53:27.492149 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:53:28.648340 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:53:28.660804 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:53:28.719010 tst mo_mt_call_osmux.py: using LAC 28528 12:53:28.855758 tst mo_mt_call_osmux.py: using RAC 223 12:53:28.985478 tst mo_mt_call_osmux.py: using CellId 28528 12:53:29.114541 tst mo_mt_call_osmux.py: using BVCI 28529 12:53:29.237528 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:53:29.249758 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:53:29.261536 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:53:29.273378 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:53:29.285735 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:53:29.297489 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:53:29.420006 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:53:29.547064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:30.074782 run create_hlr_db(pid=10115): Launched 12:53:30.241464 bus /sierra_2: Setting Powered False 12:53:31.313366 run create_hlr_db(pid=10115): Terminated: ok {rc=0} 12:53:31.770783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10117): Launched 12:53:32.082565 run osmo-hlr_10.42.42.2(pid=10118): Launched 12:53:32.310683 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:33.037914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10120): Launched 12:53:33.369808 run osmo-stp_10.42.42.5(pid=10121): Launched 12:53:33.620351 run osmo-msc_10.42.42.6: Starting osmo-msc 12:53:34.313726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10123): Launched 12:53:34.662435 run osmo-msc_10.42.42.6(pid=10124): Launched 12:53:35.030004 run osmo-stp_10.42.42.5(pid=10121): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10121)] 12:53:35.308321 run osmo-stp_10.42.42.5(pid=10121): stdout: | (launched: 2022-12-10_12:53:33.302757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:35.480316 run osmo-stp_10.42.42.5(pid=10121): stderr: | [0;m[38;5;43m20221210125333605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125333605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125333605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125333606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125333606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125333606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125333606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:35.619924 run osmo-stp_10.42.42.5(pid=10121): stdout: | (launched: 2022-12-10_12:53:33.302757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:35.761437 run osmo-stp_10.42.42.5(pid=10121): stderr: | [0;m[38;5;43m20221210125333605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125333605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125333605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125333606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125333606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125333606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125333606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:35.919728 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10121): Process ended prematurely: osmo-stp_10.42.42.5(pid=10121) [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10121)] [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:53:35.930636 tst mo_mt_call_osmux.py:8: Test FAILED (7.3 sec) 12:53:35.960814 run osmo-hlr_10.42.42.2(pid=10118): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10118)] 12:53:36.014047 run osmo-hlr_10.42.42.2(pid=10118): stdout: | (launched: 2022-12-10_12:53:32.020777) 12:53:36.067451 run osmo-hlr_10.42.42.2(pid=10118): stderr: | [0;m[1;31m20221210125332356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125332356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125332356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125332356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125332362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125332362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125332382 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125332395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125332395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125332395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:36.142234 run osmo-msc_10.42.42.6(pid=10124): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10124)] 12:53:36.196175 run osmo-msc_10.42.42.6(pid=10124): stdout: | (launched: 2022-12-10_12:53:34.587658) 12:53:36.249580 run osmo-msc_10.42.42.6(pid=10124): stderr: | [0;m[38;5;43m20221210125335100 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125335101 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f14a1f60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125335101 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125335101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125335101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125335101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125335103 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125335103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125335104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125335104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:53:36.303911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10117): Terminating (SIGTERM) 12:53:36.348082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10120): Terminating (SIGTERM) 12:53:36.395026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10123): Terminating (SIGTERM) 12:53:36.441193 --- ParallelTerminationStrategy: PID 10117 died... 12:53:36.462479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10117): Terminated: ok {rc=0} 12:53:36.511943 --- ParallelTerminationStrategy: PID 10120 died... 12:53:36.532795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10120): Terminated: ok {rc=0} 12:53:36.582962 --- ParallelTerminationStrategy: PID 10123 died... 12:53:36.603886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10123): Terminated: ok {rc=0} 12:53:36.695542 bus /sierra_3: Setting Powered False 12:53:37.799886 bus /sierra_3: Setting Powered False 12:53:38.920825 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:53:40.157788 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:53:40.164396 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:53:40.185056 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:53:40.212405 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:53:40.265824 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:53:40.287177 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:53:40.314039 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:53:40.862940 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:53:40.913989 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:53:40.925203 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:53:40.981444 tst mo_mt_call.py: using LAC 28529 12:53:41.109441 tst mo_mt_call.py: using RAC 224 12:53:41.238856 tst mo_mt_call.py: using CellId 28529 12:53:41.358963 tst mo_mt_call.py: using BVCI 28530 12:53:41.470012 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:53:41.480924 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:53:41.491977 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:53:41.503226 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:53:41.514353 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:53:41.525402 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:53:41.643489 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:53:41.764456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:42.261276 run create_hlr_db(pid=10130): Launched 12:53:42.390729 bus /sierra_2: Setting Powered False 12:53:43.454019 run create_hlr_db(pid=10130): Terminated: ok {rc=0} 12:53:43.881175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10132): Launched 12:53:44.179928 run osmo-hlr_10.42.42.2(pid=10133): Launched 12:53:44.293731 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:44.822593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10135): Launched 12:53:45.121407 run osmo-stp_10.42.42.5(pid=10136): Launched 12:53:45.236546 run osmo-msc_10.42.42.6: Starting osmo-msc 12:53:45.780665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10138): Launched 12:53:46.109980 run osmo-msc_10.42.42.6(pid=10139): Launched 12:53:46.418326 run osmo-stp_10.42.42.5(pid=10136): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10136)] 12:53:46.820292 run osmo-stp_10.42.42.5(pid=10136): stdout: | (launched: 2022-12-10_12:53:45.066786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:47.021655 run osmo-stp_10.42.42.5(pid=10136): stderr: | [0;m[38;5;43m20221210125345256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125345256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125345256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125345257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125345257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125345257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125345257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:47.153685 run osmo-stp_10.42.42.5(pid=10136): stdout: | (launched: 2022-12-10_12:53:45.066786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:47.279032 run osmo-stp_10.42.42.5(pid=10136): stderr: | [0;m[38;5;43m20221210125345256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125345256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125345256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125345257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125345257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125345257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125345257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:47.426577 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10136): Process ended prematurely: osmo-stp_10.42.42.5(pid=10136) [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10136)] [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:53:47.435449 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:53:47.462607 run osmo-hlr_10.42.42.2(pid=10133): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10133)] 12:53:47.510311 run osmo-hlr_10.42.42.2(pid=10133): stdout: | (launched: 2022-12-10_12:53:44.125555) 12:53:47.559670 run osmo-hlr_10.42.42.2(pid=10133): stderr: | [0;m[1;31m20221210125344302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125344302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125344302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125344302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125344302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125344302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125344315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125344326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125344326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125344326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:47.628319 run osmo-msc_10.42.42.6(pid=10139): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10139)] 12:53:47.675971 run osmo-msc_10.42.42.6(pid=10139): stdout: | (launched: 2022-12-10_12:53:46.035594) 12:53:47.725135 run osmo-msc_10.42.42.6(pid=10139): stderr: | [0;m[38;5;43m20221210125346542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125346542 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0fa653c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125346543 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125346543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125346543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125346543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125346545 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125346546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125346546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125346546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:53:47.774767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10132): Terminating (SIGTERM) 12:53:47.814060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10135): Terminating (SIGTERM) 12:53:47.853502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10138): Terminating (SIGTERM) 12:53:47.893050 --- ParallelTerminationStrategy: PID 10132 died... 12:53:47.911791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10132): Terminated: ok {rc=0} 12:53:47.955728 --- ParallelTerminationStrategy: PID 10135 died... 12:53:47.974763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10135): Terminated: ok {rc=0} 12:53:48.018923 --- ParallelTerminationStrategy: PID 10138 died... 12:53:48.037388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10138): Terminated: ok {rc=0} 12:53:48.123118 bus /sierra_3: Setting Powered False 12:53:49.220214 bus /sierra_3: Setting Powered False 12:53:50.335223 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:53:51.482576 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:53:51.494482 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:53:51.551385 tst mo_mt_call_osmux.py: using LAC 28530 12:53:51.682887 tst mo_mt_call_osmux.py: using RAC 225 12:53:51.808646 tst mo_mt_call_osmux.py: using CellId 28530 12:53:51.934630 tst mo_mt_call_osmux.py: using BVCI 28531 12:53:52.051042 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:53:52.062406 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:53:52.073586 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:53:52.084607 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:53:52.095733 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:53:52.106848 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:53:52.225087 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:53:52.341024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:52.805222 run create_hlr_db(pid=10141): Launched 12:53:52.919902 bus /sierra_2: Setting Powered False 12:53:53.979071 run create_hlr_db(pid=10141): Terminated: ok {rc=0} 12:53:54.415654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10143): Launched 12:53:54.719538 run osmo-hlr_10.42.42.2(pid=10144): Launched 12:53:54.834332 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:55.359831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10146): Launched 12:53:55.658420 run osmo-stp_10.42.42.5(pid=10147): Launched 12:53:55.772336 run osmo-msc_10.42.42.6: Starting osmo-msc 12:53:56.313537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10149): Launched 12:53:56.614000 run osmo-msc_10.42.42.6(pid=10150): Launched 12:53:56.782591 run osmo-stp_10.42.42.5(pid=10147): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10147)] 12:53:56.909483 run osmo-stp_10.42.42.5(pid=10147): stdout: | (launched: 2022-12-10_12:53:55.604199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:57.036446 run osmo-stp_10.42.42.5(pid=10147): stderr: | [0;m[38;5;43m20221210125355774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125355775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125355775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125355775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125355777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125355777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125355777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:57.161160 run osmo-stp_10.42.42.5(pid=10147): stdout: | (launched: 2022-12-10_12:53:55.604199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:57.279792 run osmo-stp_10.42.42.5(pid=10147): stderr: | [0;m[38;5;43m20221210125355774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125355775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125355775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125355775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125355777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125355777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125355777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:57.422325 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10147): Process ended prematurely: osmo-stp_10.42.42.5(pid=10147) [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10147)] [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:53:57.431035 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:53:57.457551 run osmo-hlr_10.42.42.2(pid=10144): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10144)] 12:53:57.505098 run osmo-hlr_10.42.42.2(pid=10144): stdout: | (launched: 2022-12-10_12:53:54.664618) 12:53:57.553770 run osmo-hlr_10.42.42.2(pid=10144): stderr: | [0;m[1;31m20221210125354841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125354841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125354841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125354841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125354841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125354841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125354853 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125354862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125354863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125354863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:57.621806 run osmo-msc_10.42.42.6(pid=10150): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10150)] 12:53:57.668931 run osmo-msc_10.42.42.6(pid=10150): stdout: | (launched: 2022-12-10_12:53:56.558978) 12:53:57.718053 run osmo-msc_10.42.42.6(pid=10150): stderr: | [0;m[38;5;43m20221210125356831 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125356832 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa470599c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125356832 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125356832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125356832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125356833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125356834 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125356835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125356835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125356835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:53:57.767508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10143): Terminating (SIGTERM) 12:53:57.806608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10146): Terminating (SIGTERM) 12:53:57.845847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10149): Terminating (SIGTERM) 12:53:57.885435 --- ParallelTerminationStrategy: PID 10143 died... 12:53:57.904244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10143): Terminated: ok {rc=0} 12:53:57.948045 --- ParallelTerminationStrategy: PID 10146 died... 12:53:57.966592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10146): Terminated: ok {rc=0} 12:53:58.010259 --- ParallelTerminationStrategy: PID 10149 died... 12:53:58.028782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10149): Terminated: ok {rc=0} 12:53:58.111420 bus /sierra_3: Setting Powered False 12:53:59.207957 bus /sierra_3: Setting Powered False 12:54:00.322153 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:54:01.576043 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:54:01.585138 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:54:01.615158 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:54:01.642266 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:54:01.696396 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:54:01.725765 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:54:01.764766 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:54:02.303873 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:54:02.355284 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:54:02.366754 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:54:02.424210 tst mo_mt_call.py: using LAC 28531 12:54:02.550265 tst mo_mt_call.py: using RAC 226 12:54:02.675886 tst mo_mt_call.py: using CellId 28531 12:54:02.800210 tst mo_mt_call.py: using BVCI 28532 12:54:02.918736 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:54:02.930150 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:54:02.941214 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:54:02.952208 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:54:02.963247 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:54:02.974347 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:54:03.094304 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:54:03.213637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:03.710865 run create_hlr_db(pid=10155): Launched 12:54:03.839799 bus /sierra_2: Setting Powered False 12:54:04.903863 run create_hlr_db(pid=10155): Terminated: ok {rc=0} 12:54:05.330703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10157): Launched 12:54:05.629844 run osmo-hlr_10.42.42.2(pid=10158): Launched 12:54:05.746679 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:06.275066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10160): Launched 12:54:06.572842 run osmo-stp_10.42.42.5(pid=10161): Launched 12:54:06.686672 run osmo-msc_10.42.42.6: Starting osmo-msc 12:54:07.226580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10163): Launched 12:54:07.525687 run osmo-msc_10.42.42.6(pid=10164): Launched 12:54:07.693820 run osmo-stp_10.42.42.5(pid=10161): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10161)] 12:54:07.822069 run osmo-stp_10.42.42.5(pid=10161): stdout: | (launched: 2022-12-10_12:54:06.518645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:07.949977 run osmo-stp_10.42.42.5(pid=10161): stderr: | [0;m[38;5;43m20221210125406688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125406688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125406688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125406689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125406689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125406689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125406689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:08.074349 run osmo-stp_10.42.42.5(pid=10161): stdout: | (launched: 2022-12-10_12:54:06.518645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:08.193059 run osmo-stp_10.42.42.5(pid=10161): stderr: | [0;m[38;5;43m20221210125406688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125406688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125406688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125406689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125406689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125406689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125406689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:08.335052 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10161): Process ended prematurely: osmo-stp_10.42.42.5(pid=10161) [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10161)] [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:54:08.343686 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 12:54:08.370181 run osmo-hlr_10.42.42.2(pid=10158): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10158)] 12:54:08.417374 run osmo-hlr_10.42.42.2(pid=10158): stdout: | (launched: 2022-12-10_12:54:05.575718) 12:54:08.466206 run osmo-hlr_10.42.42.2(pid=10158): stderr: | [0;m[1;31m20221210125405750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125405751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125405751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125405751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125405751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125405751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125405763 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125405772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125405772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125405773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:08.534363 run osmo-msc_10.42.42.6(pid=10164): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10164)] 12:54:08.581755 run osmo-msc_10.42.42.6(pid=10164): stdout: | (launched: 2022-12-10_12:54:07.471075) 12:54:08.630377 run osmo-msc_10.42.42.6(pid=10164): stderr: | [0;m[38;5;43m20221210125407744 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125407744 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f798327fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125407744 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125407744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125407745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125407745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125407747 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125407747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125407748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125407748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:54:08.679729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10157): Terminating (SIGTERM) 12:54:08.718786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10160): Terminating (SIGTERM) 12:54:08.757738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10163): Terminating (SIGTERM) 12:54:08.797271 --- ParallelTerminationStrategy: PID 10157 died... 12:54:08.815941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10157): Terminated: ok {rc=0} 12:54:08.859370 --- ParallelTerminationStrategy: PID 10160 died... 12:54:08.877553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10160): Terminated: ok {rc=0} 12:54:08.921275 --- ParallelTerminationStrategy: PID 10163 died... 12:54:08.939393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10163): Terminated: ok {rc=0} 12:54:09.023631 bus /sierra_3: Setting Powered False 12:54:10.121936 bus /sierra_3: Setting Powered False 12:54:11.236410 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:54:12.380203 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:54:12.391571 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:54:12.446486 tst mo_mt_call_osmux.py: using LAC 28532 12:54:12.567324 tst mo_mt_call_osmux.py: using RAC 227 12:54:12.699029 tst mo_mt_call_osmux.py: using CellId 28532 12:54:12.825303 tst mo_mt_call_osmux.py: using BVCI 28533 12:54:12.942140 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:54:12.953996 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:54:12.965330 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:54:12.977293 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:54:12.988801 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:54:13.000404 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:54:13.116657 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:54:13.238932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:13.738446 run create_hlr_db(pid=10166): Launched 12:54:13.867973 bus /sierra_2: Setting Powered False 12:54:14.932073 run create_hlr_db(pid=10166): Terminated: ok {rc=0} 12:54:15.359110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10168): Launched 12:54:15.658329 run osmo-hlr_10.42.42.2(pid=10169): Launched 12:54:15.774515 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:16.440591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10171): Launched 12:54:16.761693 run osmo-stp_10.42.42.5(pid=10172): Launched 12:54:16.971563 run osmo-msc_10.42.42.6: Starting osmo-msc 12:54:17.686355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10174): Launched 12:54:18.005727 run osmo-msc_10.42.42.6(pid=10175): Launched 12:54:18.185237 run osmo-stp_10.42.42.5(pid=10172): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10172)] 12:54:18.320640 run osmo-stp_10.42.42.5(pid=10172): stdout: | (launched: 2022-12-10_12:54:16.697152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:18.456125 run osmo-stp_10.42.42.5(pid=10172): stderr: | [0;m[38;5;43m20221210125417003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125417003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125417003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125417004 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125417004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125417004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125417004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:18.591526 run osmo-stp_10.42.42.5(pid=10172): stdout: | (launched: 2022-12-10_12:54:16.697152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:18.719146 run osmo-stp_10.42.42.5(pid=10172): stderr: | [0;m[38;5;43m20221210125417003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125417003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125417003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125417004 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125417004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125417004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125417004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:18.871743 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10172): Process ended prematurely: osmo-stp_10.42.42.5(pid=10172) [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10172)] [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:54:18.881324 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:54:18.908699 run osmo-hlr_10.42.42.2(pid=10169): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10169)] 12:54:18.958091 run osmo-hlr_10.42.42.2(pid=10169): stdout: | (launched: 2022-12-10_12:54:15.604178) 12:54:19.009325 run osmo-hlr_10.42.42.2(pid=10169): stderr: | [0;m[1;31m20221210125415777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125415777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125415777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125415777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125415778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125415778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125415789 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125415798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125415798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125415798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:19.081069 run osmo-msc_10.42.42.6(pid=10175): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10175)] 12:54:19.130337 run osmo-msc_10.42.42.6(pid=10175): stdout: | (launched: 2022-12-10_12:54:17.947812) 12:54:19.181269 run osmo-msc_10.42.42.6(pid=10175): stderr: | [0;m[38;5;43m20221210125418269 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125418269 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f93ca052c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125418269 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125418269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125418269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125418270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125418271 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125418272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125418272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125418272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:54:19.232562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10168): Terminating (SIGTERM) 12:54:19.273341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10171): Terminating (SIGTERM) 12:54:19.314598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10174): Terminating (SIGTERM) 12:54:19.355916 --- ParallelTerminationStrategy: PID 10168 died... 12:54:19.375658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10168): Terminated: ok {rc=0} 12:54:19.421649 --- ParallelTerminationStrategy: PID 10171 died... 12:54:19.441073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10171): Terminated: ok {rc=0} 12:54:19.486278 --- ParallelTerminationStrategy: PID 10174 died... 12:54:19.505682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10174): Terminated: ok {rc=0} 12:54:19.592200 bus /sierra_3: Setting Powered False 12:54:20.688309 bus /sierra_3: Setting Powered False 12:54:21.805602 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:54:23.030719 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:54:23.036864 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:54:23.057497 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:54:23.084151 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:54:23.135479 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:54:23.155499 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:54:23.181888 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:54:23.731245 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:54:23.779467 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:54:23.790351 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:54:23.847634 tst mo_mt_call.py: using LAC 28533 12:54:23.965345 tst mo_mt_call.py: using RAC 228 12:54:24.080618 tst mo_mt_call.py: using CellId 28533 12:54:24.196883 tst mo_mt_call.py: using BVCI 28534 12:54:24.306155 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:54:24.317026 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:54:24.327629 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:54:24.338574 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:54:24.349527 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:54:24.360658 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:54:24.479706 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:54:24.594115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:25.057135 run create_hlr_db(pid=10180): Launched 12:54:25.180612 bus /sierra_2: Setting Powered False 12:54:26.240251 run create_hlr_db(pid=10180): Terminated: ok {rc=0} 12:54:26.656459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10182): Launched 12:54:26.954081 run osmo-hlr_10.42.42.2(pid=10183): Launched 12:54:27.067843 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:27.600579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10185): Launched 12:54:27.900216 run osmo-stp_10.42.42.5(pid=10186): Launched 12:54:28.015288 run osmo-msc_10.42.42.6: Starting osmo-msc 12:54:28.557154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10188): Launched 12:54:28.856345 run osmo-msc_10.42.42.6(pid=10189): Launched 12:54:29.024783 run osmo-stp_10.42.42.5(pid=10186): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10186)] 12:54:29.159847 run osmo-stp_10.42.42.5(pid=10186): stdout: | (launched: 2022-12-10_12:54:27.845466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:29.297571 run osmo-stp_10.42.42.5(pid=10186): stderr: | [0;m[38;5;43m20221210125428015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125428015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125428015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125428016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125428016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125428016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125428016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:29.431791 run osmo-stp_10.42.42.5(pid=10186): stdout: | (launched: 2022-12-10_12:54:27.845466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:29.559755 run osmo-stp_10.42.42.5(pid=10186): stderr: | [0;m[38;5;43m20221210125428015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125428015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125428015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125428016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125428016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125428016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125428016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:29.714119 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10186): Process ended prematurely: osmo-stp_10.42.42.5(pid=10186) [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10186)] [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:54:29.723535 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 12:54:29.751818 run osmo-hlr_10.42.42.2(pid=10183): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10183)] 12:54:29.802591 run osmo-hlr_10.42.42.2(pid=10183): stdout: | (launched: 2022-12-10_12:54:26.899868) 12:54:29.854347 run osmo-hlr_10.42.42.2(pid=10183): stderr: | [0;m[1;31m20221210125427077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125427077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125427077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125427077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125427077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125427077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125427089 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125427097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125427097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125427097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:29.926237 run osmo-msc_10.42.42.6(pid=10189): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10189)] 12:54:29.975785 run osmo-msc_10.42.42.6(pid=10189): stdout: | (launched: 2022-12-10_12:54:28.801692) 12:54:30.026619 run osmo-msc_10.42.42.6(pid=10189): stderr: | [0;m[38;5;43m20221210125429073 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125429073 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efdad9fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125429073 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125429073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125429073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125429074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125429076 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125429076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125429077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125429077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:54:30.077924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10182): Terminating (SIGTERM) 12:54:30.118924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10185): Terminating (SIGTERM) 12:54:30.160049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10188): Terminating (SIGTERM) 12:54:30.202355 --- ParallelTerminationStrategy: PID 10182 died... 12:54:30.221885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10182): Terminated: ok {rc=0} 12:54:30.267655 --- ParallelTerminationStrategy: PID 10185 died... 12:54:30.287006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10185): Terminated: ok {rc=0} 12:54:30.332545 --- ParallelTerminationStrategy: PID 10188 died... 12:54:30.351925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10188): Terminated: ok {rc=0} 12:54:30.439647 bus /sierra_3: Setting Powered False 12:54:31.535981 bus /sierra_3: Setting Powered False 12:54:32.655094 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:54:33.799572 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:54:33.811035 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:54:33.866127 tst mo_mt_call_osmux.py: using LAC 28534 12:54:33.986175 tst mo_mt_call_osmux.py: using RAC 229 12:54:34.105363 tst mo_mt_call_osmux.py: using CellId 28534 12:54:34.225639 tst mo_mt_call_osmux.py: using BVCI 28535 12:54:34.345857 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:54:34.357405 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:54:34.368617 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:54:34.380495 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:54:34.392271 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:54:34.403966 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:54:34.523836 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:54:34.641537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:35.107122 run create_hlr_db(pid=10191): Launched 12:54:35.221540 bus /sierra_2: Setting Powered False 12:54:36.282100 run create_hlr_db(pid=10191): Terminated: ok {rc=0} 12:54:36.720469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10193): Launched 12:54:37.041172 run osmo-hlr_10.42.42.2(pid=10194): Launched 12:54:37.163570 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:37.718760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10196): Launched 12:54:38.038500 run osmo-stp_10.42.42.5(pid=10197): Launched 12:54:38.160709 run osmo-msc_10.42.42.6: Starting osmo-msc 12:54:38.739567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10199): Launched 12:54:39.059615 run osmo-msc_10.42.42.6(pid=10200): Launched 12:54:39.238963 run osmo-stp_10.42.42.5(pid=10197): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10197)] 12:54:39.374101 run osmo-stp_10.42.42.5(pid=10197): stdout: | (launched: 2022-12-10_12:54:37.980481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:39.509586 run osmo-stp_10.42.42.5(pid=10197): stderr: | [0;m[38;5;43m20221210125438172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125438172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125438173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125438173 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125438174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125438174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125438174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:39.645365 run osmo-stp_10.42.42.5(pid=10197): stdout: | (launched: 2022-12-10_12:54:37.980481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:39.773216 run osmo-stp_10.42.42.5(pid=10197): stderr: | [0;m[38;5;43m20221210125438172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125438172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125438173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125438173 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125438174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125438174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125438174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:39.925974 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10197): Process ended prematurely: osmo-stp_10.42.42.5(pid=10197) [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10197)] [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:54:39.935516 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:54:39.963561 run osmo-hlr_10.42.42.2(pid=10194): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10194)] 12:54:40.013527 run osmo-hlr_10.42.42.2(pid=10194): stdout: | (launched: 2022-12-10_12:54:36.982520) 12:54:40.064808 run osmo-hlr_10.42.42.2(pid=10194): stderr: | [0;m[1;31m20221210125437179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125437179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125437179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125437179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125437179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125437179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125437192 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125437200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125437200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125437200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:40.136370 run osmo-msc_10.42.42.6(pid=10200): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10200)] 12:54:40.185827 run osmo-msc_10.42.42.6(pid=10200): stdout: | (launched: 2022-12-10_12:54:39.001391) 12:54:40.236617 run osmo-msc_10.42.42.6(pid=10200): stderr: | [0;m[38;5;43m20221210125439323 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125439323 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f26c6d00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125439323 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125439323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125439323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125439323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125439325 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125439325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125439326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125439326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:54:40.287875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10193): Terminating (SIGTERM) 12:54:40.329018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10196): Terminating (SIGTERM) 12:54:40.370288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10199): Terminating (SIGTERM) 12:54:40.411926 --- ParallelTerminationStrategy: PID 10193 died... 12:54:40.431793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10193): Terminated: ok {rc=0} 12:54:40.477793 --- ParallelTerminationStrategy: PID 10196 died... 12:54:40.496920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10196): Terminated: ok {rc=0} 12:54:40.542653 --- ParallelTerminationStrategy: PID 10199 died... 12:54:40.562044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10199): Terminated: ok {rc=0} 12:54:40.648715 bus /sierra_3: Setting Powered False 12:54:41.746524 bus /sierra_3: Setting Powered False 12:54:42.863474 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:54:44.101907 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:54:44.108685 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:54:44.129703 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:54:44.156632 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:54:44.208099 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:54:44.229044 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:54:44.255858 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:54:44.807733 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:54:44.858655 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:54:44.869976 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:54:44.929964 tst mo_mt_call.py: using LAC 28535 12:54:45.059496 tst mo_mt_call.py: using RAC 230 12:54:45.185467 tst mo_mt_call.py: using CellId 28535 12:54:45.304150 tst mo_mt_call.py: using BVCI 28536 12:54:45.414474 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:54:45.425578 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:54:45.436428 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:54:45.448093 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:54:45.459482 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:54:45.470935 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:54:45.590221 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:54:45.707272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:46.253190 run create_hlr_db(pid=10205): Launched 12:54:46.410580 bus /sierra_2: Setting Powered False 12:54:47.474266 run create_hlr_db(pid=10205): Terminated: ok {rc=0} 12:54:47.900818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10207): Launched 12:54:48.199377 run osmo-hlr_10.42.42.2(pid=10208): Launched 12:54:48.313488 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:48.826685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10210): Launched 12:54:49.125475 run osmo-stp_10.42.42.5(pid=10211): Launched 12:54:49.240053 run osmo-msc_10.42.42.6: Starting osmo-msc 12:54:49.784578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10213): Launched 12:54:50.083485 run osmo-msc_10.42.42.6(pid=10214): Launched 12:54:50.251366 run osmo-stp_10.42.42.5(pid=10211): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10211)] 12:54:50.379040 run osmo-stp_10.42.42.5(pid=10211): stdout: | (launched: 2022-12-10_12:54:49.070623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:50.506562 run osmo-stp_10.42.42.5(pid=10211): stderr: | [0;m[38;5;43m20221210125449241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125449241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125449241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125449242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125449242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125449242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125449242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:50.631255 run osmo-stp_10.42.42.5(pid=10211): stdout: | (launched: 2022-12-10_12:54:49.070623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:50.750665 run osmo-stp_10.42.42.5(pid=10211): stderr: | [0;m[38;5;43m20221210125449241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125449241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125449241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125449242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125449242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125449242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125449242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:50.893640 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10211): Process ended prematurely: osmo-stp_10.42.42.5(pid=10211) [trial-2375↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10211)] [trial-2375↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:54:50.902452 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:54:50.929554 run osmo-hlr_10.42.42.2(pid=10208): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10208)] 12:54:50.977167 run osmo-hlr_10.42.42.2(pid=10208): stdout: | (launched: 2022-12-10_12:54:48.144794) 12:54:51.026373 run osmo-hlr_10.42.42.2(pid=10208): stderr: | [0;m[1;31m20221210125448319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125448319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125448319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125448319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125448319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125448319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125448364 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125448374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125448374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125448374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:51.095012 run osmo-msc_10.42.42.6(pid=10214): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10214)] 12:54:51.142471 run osmo-msc_10.42.42.6(pid=10214): stdout: | (launched: 2022-12-10_12:54:50.029228) 12:54:51.191528 run osmo-msc_10.42.42.6(pid=10214): stderr: | [0;m[38;5;43m20221210125450301 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125450301 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f73c7993c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125450301 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125450301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125450301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125450301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125450303 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125450304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125450304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125450304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:54:51.241145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10207): Terminating (SIGTERM) 12:54:51.280491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10210): Terminating (SIGTERM) 12:54:51.319811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10213): Terminating (SIGTERM) 12:54:51.359414 --- ParallelTerminationStrategy: PID 10207 died... 12:54:51.378247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10207): Terminated: ok {rc=0} 12:54:51.421945 --- ParallelTerminationStrategy: PID 10210 died... 12:54:51.440408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10210): Terminated: ok {rc=0} 12:54:51.485151 --- ParallelTerminationStrategy: PID 10213 died... 12:54:51.503684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10213): Terminated: ok {rc=0} 12:54:51.589839 bus /sierra_3: Setting Powered False 12:54:52.688493 bus /sierra_3: Setting Powered False 12:54:53.803958 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:54:54.949812 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:54:54.961810 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:54:55.020496 tst mo_mt_call_osmux.py: using LAC 28536 12:54:55.148153 tst mo_mt_call_osmux.py: using RAC 231 12:54:55.269841 tst mo_mt_call_osmux.py: using CellId 28536 12:54:55.391610 tst mo_mt_call_osmux.py: using BVCI 28537 12:54:55.501664 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:54:55.512729 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:54:55.523727 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:54:55.535575 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:54:55.547475 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:54:55.559309 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:54:55.675461 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:54:55.796117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:56.296719 run create_hlr_db(pid=10216): Launched 12:54:56.427164 bus /sierra_2: Setting Powered False 12:54:57.490392 run create_hlr_db(pid=10216): Terminated: ok {rc=0} 12:54:57.918610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10218): Launched 12:54:58.217784 run osmo-hlr_10.42.42.2(pid=10219): Launched 12:54:58.331844 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:58.863185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10221): Launched 12:54:59.163065 run osmo-stp_10.42.42.5(pid=10222): Launched 12:54:59.277783 run osmo-msc_10.42.42.6: Starting osmo-msc 12:54:59.820428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10224): Launched 12:55:00.121109 run osmo-msc_10.42.42.6(pid=10225): Launched 12:55:00.289702 run osmo-stp_10.42.42.5(pid=10222): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10222)] 12:55:00.417820 run osmo-stp_10.42.42.5(pid=10222): stdout: | (launched: 2022-12-10_12:54:59.108565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:00.546258 run osmo-stp_10.42.42.5(pid=10222): stderr: | [0;m[38;5;43m20221210125459278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125459278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125459278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125459279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125459279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125459279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125459279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:00.671771 run osmo-stp_10.42.42.5(pid=10222): stdout: | (launched: 2022-12-10_12:54:59.108565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:00.791180 run osmo-stp_10.42.42.5(pid=10222): stderr: | [0;m[38;5;43m20221210125459278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125459278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125459278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125459279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125459279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125459279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125459279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:00.954550 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10222): Process ended prematurely: osmo-stp_10.42.42.5(pid=10222) [trial-2375↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10222)] [trial-2375↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:55:00.963746 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:55:00.991483 run osmo-hlr_10.42.42.2(pid=10219): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10219)] 12:55:01.041471 run osmo-hlr_10.42.42.2(pid=10219): stdout: | (launched: 2022-12-10_12:54:58.163249) 12:55:01.094605 run osmo-hlr_10.42.42.2(pid=10219): stderr: | [0;m[1;31m20221210125458338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125458338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125458338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125458338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125458338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125458338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125458350 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125458359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125458360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125458360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:01.168918 run osmo-msc_10.42.42.6(pid=10225): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10225)] 12:55:01.221695 run osmo-msc_10.42.42.6(pid=10225): stdout: | (launched: 2022-12-10_12:55:00.066172) 12:55:01.274385 run osmo-msc_10.42.42.6(pid=10225): stderr: | [0;m[38;5;43m20221210125500338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125500338 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbde5417c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125500338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125500338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125500338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125500338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125500340 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125500340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125500341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125500341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:55:01.328116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10218): Terminating (SIGTERM) 12:55:01.371365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10221): Terminating (SIGTERM) 12:55:01.417715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10224): Terminating (SIGTERM) 12:55:01.463082 --- ParallelTerminationStrategy: PID 10218 died... 12:55:01.483489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10218): Terminated: ok {rc=0} 12:55:01.531953 --- ParallelTerminationStrategy: PID 10221 died... 12:55:01.552553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10221): Terminated: ok {rc=0} 12:55:01.602559 --- ParallelTerminationStrategy: PID 10224 died... 12:55:01.622974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10224): Terminated: ok {rc=0} 12:55:01.712707 bus /sierra_3: Setting Powered False 12:55:02.807820 bus /sierra_3: Setting Powered False 12:55:03.917410 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:55:05.153215 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:55:05.159272 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:55:05.180584 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:55:05.207963 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:55:05.258379 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:55:05.279311 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:55:05.306636 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:55:05.857932 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:55:05.909235 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:55:05.920031 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:55:05.974718 tst mo_mt_call.py: using LAC 28537 12:55:06.094693 tst mo_mt_call.py: using RAC 232 12:55:06.213384 tst mo_mt_call.py: using CellId 28537 12:55:06.339941 tst mo_mt_call.py: using BVCI 28538 12:55:06.457586 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:55:06.468871 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:55:06.480188 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:55:06.491381 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:55:06.502854 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:55:06.514262 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:55:06.630952 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:55:06.749411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:07.214368 run create_hlr_db(pid=10240): Launched 12:55:07.329664 bus /sierra_2: Setting Powered False 12:55:08.393244 run create_hlr_db(pid=10240): Terminated: ok {rc=0} 12:55:08.838020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10242): Launched 12:55:09.156811 run osmo-hlr_10.42.42.2(pid=10243): Launched 12:55:09.279148 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:09.831623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10245): Launched 12:55:10.152883 run osmo-stp_10.42.42.5(pid=10246): Launched 12:55:10.275320 run osmo-msc_10.42.42.6: Starting osmo-msc 12:55:10.856448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10248): Launched 12:55:11.178890 run osmo-msc_10.42.42.6(pid=10249): Launched 12:55:11.357682 run osmo-stp_10.42.42.5(pid=10246): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10246)] 12:55:11.492873 run osmo-stp_10.42.42.5(pid=10246): stdout: | (launched: 2022-12-10_12:55:10.094673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:11.628776 run osmo-stp_10.42.42.5(pid=10246): stderr: | [0;m[38;5;43m20221210125510286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125510286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125510287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125510287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125510288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125510288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125510288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:11.763553 run osmo-stp_10.42.42.5(pid=10246): stdout: | (launched: 2022-12-10_12:55:10.094673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:11.891372 run osmo-stp_10.42.42.5(pid=10246): stderr: | [0;m[38;5;43m20221210125510286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125510286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125510287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125510287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125510288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125510288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125510288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:12.044845 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10246): Process ended prematurely: osmo-stp_10.42.42.5(pid=10246) [trial-2375↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10246)] [trial-2375↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:55:12.054534 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:55:12.082657 run osmo-hlr_10.42.42.2(pid=10243): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10243)] 12:55:12.132728 run osmo-hlr_10.42.42.2(pid=10243): stdout: | (launched: 2022-12-10_12:55:09.099024) 12:55:12.184611 run osmo-hlr_10.42.42.2(pid=10243): stderr: | [0;m[1;31m20221210125509299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125509299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125509299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125509299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125509299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125509299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125509312 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125509322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125509322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125509322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:12.256990 run osmo-msc_10.42.42.6(pid=10249): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10249)] 12:55:12.307025 run osmo-msc_10.42.42.6(pid=10249): stdout: | (launched: 2022-12-10_12:55:11.118695) 12:55:12.358738 run osmo-msc_10.42.42.6(pid=10249): stderr: | [0;m[38;5;43m20221210125511443 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125511443 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2988033c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125511443 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125511443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125511444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125511444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125511446 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125511446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125511446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125511446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:55:12.410660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10242): Terminating (SIGTERM) 12:55:12.452454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10245): Terminating (SIGTERM) 12:55:12.495007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10248): Terminating (SIGTERM) 12:55:12.540593 --- ParallelTerminationStrategy: PID 10242 died... 12:55:12.560753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10242): Terminated: ok {rc=0} 12:55:12.618554 --- ParallelTerminationStrategy: PID 10245 died... 12:55:12.642909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10245): Terminated: ok {rc=0} 12:55:12.689992 --- ParallelTerminationStrategy: PID 10248 died... 12:55:12.710042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10248): Terminated: ok {rc=0} 12:55:12.799923 bus /sierra_3: Setting Powered False 12:55:13.905917 bus /sierra_3: Setting Powered False 12:55:15.020687 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:55:16.172924 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:55:16.185325 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:55:16.244530 tst mo_mt_call_osmux.py: using LAC 28538 12:55:16.373463 tst mo_mt_call_osmux.py: using RAC 233 12:55:16.499977 tst mo_mt_call_osmux.py: using CellId 28538 12:55:16.660728 tst mo_mt_call_osmux.py: using BVCI 28539 12:55:16.808575 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:55:16.825700 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:55:16.839613 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:55:16.852104 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:55:16.864151 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:55:16.876156 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:55:16.997550 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:55:17.123567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:17.618660 run create_hlr_db(pid=10603): Launched 12:55:17.734684 bus /sierra_2: Setting Powered False 12:55:18.794964 run create_hlr_db(pid=10603): Terminated: ok {rc=0} 12:55:19.232568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10605): Launched 12:55:19.553269 run osmo-hlr_10.42.42.2(pid=10606): Launched 12:55:19.677610 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:20.235123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10608): Launched 12:55:20.555393 run osmo-stp_10.42.42.5(pid=10609): Launched 12:55:20.679592 run osmo-msc_10.42.42.6: Starting osmo-msc 12:55:21.265741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10611): Launched 12:55:21.587604 run osmo-msc_10.42.42.6(pid=10612): Launched 12:55:21.767641 run osmo-stp_10.42.42.5(pid=10609): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10609)] 12:55:21.905301 run osmo-stp_10.42.42.5(pid=10609): stdout: | (launched: 2022-12-10_12:55:20.497189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:22.043481 run osmo-stp_10.42.42.5(pid=10609): stderr: | [0;m[38;5;43m20221210125520690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125520690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125520690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125520690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125520691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125520691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125520691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:22.178201 run osmo-stp_10.42.42.5(pid=10609): stdout: | (launched: 2022-12-10_12:55:20.497189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:22.305988 run osmo-stp_10.42.42.5(pid=10609): stderr: | [0;m[38;5;43m20221210125520690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125520690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125520690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125520690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125520691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125520691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125520691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:22.458957 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10609): Process ended prematurely: osmo-stp_10.42.42.5(pid=10609) [trial-2375↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10609)] [trial-2375↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:55:22.468425 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:55:22.496315 run osmo-hlr_10.42.42.2(pid=10606): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10606)] 12:55:22.546115 run osmo-hlr_10.42.42.2(pid=10606): stdout: | (launched: 2022-12-10_12:55:19.494755) 12:55:22.597619 run osmo-hlr_10.42.42.2(pid=10606): stderr: | [0;m[1;31m20221210125519692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125519692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125519692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125519692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125519692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125519692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125519705 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125519713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125519713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125519713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:22.669220 run osmo-msc_10.42.42.6(pid=10612): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10612)] 12:55:22.718901 run osmo-msc_10.42.42.6(pid=10612): stdout: | (launched: 2022-12-10_12:55:21.528873) 12:55:22.770656 run osmo-msc_10.42.42.6(pid=10612): stderr: | [0;m[38;5;43m20221210125521850 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125521850 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4318eb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125521850 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125521850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125521850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125521850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125521852 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125521852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125521853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125521853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:55:22.822212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10605): Terminating (SIGTERM) 12:55:22.863203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10608): Terminating (SIGTERM) 12:55:22.907138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10611): Terminating (SIGTERM) 12:55:22.952736 --- ParallelTerminationStrategy: PID 10605 died... 12:55:22.972875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10605): Terminated: ok {rc=0} 12:55:23.021560 --- ParallelTerminationStrategy: PID 10608 died... 12:55:23.041429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10608): Terminated: ok {rc=0} 12:55:23.088103 --- ParallelTerminationStrategy: PID 10611 died... 12:55:23.108042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10611): Terminated: ok {rc=0} 12:55:23.194984 bus /sierra_3: Setting Powered False 12:55:24.296710 bus /sierra_3: Setting Powered False 12:55:25.414818 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 emergency:oc2g --------------------------------------------------------------------- 12:55:26.649553 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:55:26.654847 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 12:55:26.677199 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 12:55:26.705378 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 12:55:26.791590 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 12:55:26.813460 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 12:55:26.843034 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 12:55:27.423590 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2375 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 12:55:27.430349 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:55:27.442140 tst emergency:oc2g: Using 1 x bts (candidates: 1) 12:55:27.478465 tst emergency_mo_mt_call.py: using LAC 28539 12:55:27.607295 tst emergency_mo_mt_call.py: using RAC 234 12:55:27.733992 tst emergency_mo_mt_call.py: using CellId 28539 12:55:27.864235 tst emergency_mo_mt_call.py: using BVCI 28540 12:55:27.983123 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:55:27.996036 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:55:28.008508 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:55:28.020559 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:55:28.032728 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:55:28.045310 tst emergency:oc2g: Using 1 x modem (candidates: 4) 12:55:28.166898 tst emergency:oc2g: Using 1 x modem (candidates: 4) 12:55:28.289564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:28.805703 run create_hlr_db(pid=10793): Launched 12:55:28.955208 bus /sierra_2: Setting Powered False 12:55:30.017852 run create_hlr_db(pid=10793): Terminated: ok {rc=0} 12:55:30.457865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10795): Launched 12:55:30.772757 run osmo-hlr_10.42.42.2(pid=10796): Launched 12:55:30.932716 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:31.626019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10798): Launched 12:55:31.995336 run osmo-stp_10.42.42.5(pid=10799): Launched 12:55:32.255655 tst emergency_mo_mt_call.py: using MSISDN 7749 12:55:32.448446 run osmo-msc_10.42.42.6: Starting osmo-msc 12:55:33.016784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10801): Launched 12:55:33.332273 run osmo-msc_10.42.42.6(pid=10802): Launched 12:55:33.507697 run osmo-stp_10.42.42.5(pid=10799): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10799)] 12:55:33.640882 run osmo-stp_10.42.42.5(pid=10799): stdout: | (launched: 2022-12-10_12:55:31.931267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:33.774167 run osmo-stp_10.42.42.5(pid=10799): stderr: | [0;m[38;5;43m20221210125532206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125532206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125532207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125532207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125532207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125532208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125532208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:33.907113 run osmo-stp_10.42.42.5(pid=10799): stdout: | (launched: 2022-12-10_12:55:31.931267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:34.032428 run osmo-stp_10.42.42.5(pid=10799): stderr: | [0;m[38;5;43m20221210125532206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125532206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125532207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125532207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125532207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125532208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125532208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:34.182928 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10799): Process ended prematurely: osmo-stp_10.42.42.5(pid=10799) [trial-2375↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10799)] [trial-2375↪emergency:oc2g↪emergency_mo_mt_call.py:19] 12:55:34.191711 tst emergency_mo_mt_call.py:19: Test FAILED (6.8 sec) 12:55:34.219507 run osmo-hlr_10.42.42.2(pid=10796): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10796)] 12:55:34.269871 run osmo-hlr_10.42.42.2(pid=10796): stdout: | (launched: 2022-12-10_12:55:30.715382) 12:55:34.321630 run osmo-hlr_10.42.42.2(pid=10796): stderr: | [0;m[1;31m20221210125531034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125531034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125531034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125531034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125531034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125531034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125531053 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125531072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125531075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125531075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:34.394140 run osmo-msc_10.42.42.6(pid=10802): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10802)] 12:55:34.444114 run osmo-msc_10.42.42.6(pid=10802): stdout: | (launched: 2022-12-10_12:55:33.274695) 12:55:34.495951 run osmo-msc_10.42.42.6(pid=10802): stderr: | [0;m[38;5;43m20221210125533602 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125533602 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9143999c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125533602 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125533602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125533603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125533603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125533605 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125533605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125533605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125533605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:55:34.547793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10795): Terminating (SIGTERM) 12:55:34.589398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10798): Terminating (SIGTERM) 12:55:34.631666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10801): Terminating (SIGTERM) 12:55:34.673825 --- ParallelTerminationStrategy: PID 10795 died... 12:55:34.693775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10795): Terminated: ok {rc=0} 12:55:34.740256 --- ParallelTerminationStrategy: PID 10798 died... 12:55:34.760023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10798): Terminated: ok {rc=0} 12:55:34.806072 --- ParallelTerminationStrategy: PID 10801 died... 12:55:34.825766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10801): Terminated: ok {rc=0} 12:55:34.913318 bus /sierra_3: Setting Powered False 12:55:36.011788 bus /sierra_3: Setting Powered False 12:55:37.126199 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 12:55:38.215157 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:55:38.227181 tst emergency:oc2g: Using 1 x bts (candidates: 1) 12:55:38.265753 tst emergency_preemptive_call.py: using LAC 28540 12:55:38.390955 tst emergency_preemptive_call.py: using RAC 235 12:55:38.519001 tst emergency_preemptive_call.py: using CellId 28540 12:55:38.642577 tst emergency_preemptive_call.py: using BVCI 28541 12:55:38.759180 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:55:38.770082 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:55:38.780767 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:55:38.791557 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:55:38.802263 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:55:38.812797 tst emergency:oc2g: Using 1 x modem (candidates: 4) 12:55:38.930672 tst emergency:oc2g: Using 1 x modem (candidates: 4) 12:55:39.047462 tst emergency:oc2g: Using 1 x modem (candidates: 4) 12:55:39.161752 tst emergency:oc2g: Using 1 x modem (candidates: 4) 12:55:39.276033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:39.735981 run create_hlr_db(pid=10804): Launched 12:55:39.849845 bus /sierra_2: Setting Powered False 12:55:40.909738 run create_hlr_db(pid=10804): Terminated: ok {rc=0} 12:55:41.341586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10806): Launched 12:55:41.658699 run osmo-hlr_10.42.42.2(pid=10807): Launched 12:55:41.778499 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:42.347416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10809): Launched 12:55:42.664051 run osmo-stp_10.42.42.5(pid=10810): Launched 12:55:42.794683 tst emergency_preemptive_call.py: using MSISDN 7750 12:55:42.957592 run osmo-msc_10.42.42.6: Starting osmo-msc 12:55:43.523529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10812): Launched 12:55:43.839923 run osmo-msc_10.42.42.6(pid=10813): Launched 12:55:44.015559 run osmo-stp_10.42.42.5(pid=10810): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10810)] 12:55:44.148787 run osmo-stp_10.42.42.5(pid=10810): stdout: | (launched: 2022-12-10_12:55:42.606046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:44.282975 run osmo-stp_10.42.42.5(pid=10810): stderr: | [0;m[38;5;43m20221210125542797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125542797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125542797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125542798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125542798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125542798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125542798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:44.415885 run osmo-stp_10.42.42.5(pid=10810): stdout: | (launched: 2022-12-10_12:55:42.606046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:44.541064 run osmo-stp_10.42.42.5(pid=10810): stderr: | [0;m[38;5;43m20221210125542797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125542797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125542797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125542798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125542798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125542798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125542798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:44.691455 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10810): Process ended prematurely: osmo-stp_10.42.42.5(pid=10810) [trial-2375↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10810)] [trial-2375↪emergency:oc2g↪emergency_preemptive_call.py:32] 12:55:44.700138 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 12:55:44.727295 run osmo-hlr_10.42.42.2(pid=10807): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10807)] 12:55:44.777724 run osmo-hlr_10.42.42.2(pid=10807): stdout: | (launched: 2022-12-10_12:55:41.600729) 12:55:44.829292 run osmo-hlr_10.42.42.2(pid=10807): stderr: | [0;m[1;31m20221210125541800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125541800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125541800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125541800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125541800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125541800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125541813 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125541821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125541821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125541821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:44.901331 run osmo-msc_10.42.42.6(pid=10813): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10813)] 12:55:44.951396 run osmo-msc_10.42.42.6(pid=10813): stdout: | (launched: 2022-12-10_12:55:43.781166) 12:55:45.002847 run osmo-msc_10.42.42.6(pid=10813): stderr: | [0;m[38;5;43m20221210125544103 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210125544103 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f56c8b75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210125544104 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210125544104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210125544104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210125544104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210125544106 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210125544106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210125544106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210125544107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:55:45.054933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10806): Terminating (SIGTERM) 12:55:45.096286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10809): Terminating (SIGTERM) 12:55:45.137912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10812): Terminating (SIGTERM) 12:55:45.179726 --- ParallelTerminationStrategy: PID 10806 died... 12:55:45.199713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10806): Terminated: ok {rc=0} 12:55:45.245670 --- ParallelTerminationStrategy: PID 10809 died... 12:55:45.264942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10809): Terminated: ok {rc=0} 12:55:45.310875 --- ParallelTerminationStrategy: PID 10812 died... 12:55:45.330708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10812): Terminated: ok {rc=0} 12:55:45.418333 bus /sierra_9: Setting Powered False 12:55:46.517224 bus /sierra_9: Setting Powered False 12:55:47.631518 bus /sierra_8: Setting Powered False 12:55:48.729702 bus /sierra_8: Setting Powered False 12:55:49.845197 bus /sierra_3: Setting Powered False 12:55:50.942829 bus /sierra_3: Setting Powered False 12:55:52.061115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:oc2g --------------------------------------------------------------------- 12:55:53.316334 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:55:53.320503 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 12:55:53.340666 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 12:55:53.380191 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 12:55:53.465952 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 12:55:53.486209 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 12:55:53.524527 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 12:55:54.113868 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 12:55:54.163827 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:55:54.174280 tst gprs:oc2g: Using 1 x bts (candidates: 1) 12:55:54.207372 tst cs_paging_gprs_active.py: using LAC 28541 12:55:54.325390 tst cs_paging_gprs_active.py: using RAC 236 12:55:54.444021 tst cs_paging_gprs_active.py: using CellId 28541 12:55:54.561804 tst cs_paging_gprs_active.py: using BVCI 28542 12:55:54.680879 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:55:54.691797 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:55:54.702713 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:55:54.713655 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:55:54.724403 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:55:54.735265 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:55:54.746241 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:55:54.757157 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:55:54.767962 tst gprs:oc2g: Using 1 x modem (candidates: 4) 12:55:54.884144 tst gprs:oc2g: Using 1 x modem (candidates: 4) 12:55:55.003101 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:55:55.204033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:55:55.505450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10818): Launched 12:55:55.769664 run iperf3-srv_10.42.42.10(pid=10819): Launched 12:55:55.884136 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:55:56.087544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:55:56.391722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10820): Launched 12:55:56.655145 run iperf3-srv_10.42.42.10(pid=10821): Launched 12:55:56.769428 tst cs_paging_gprs_active.py:38: start network... 12:55:56.970944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:57.437514 run create_hlr_db(pid=10822): Launched 12:55:57.554042 bus /sierra_2: Setting Powered False 12:55:58.614279 run create_hlr_db(pid=10822): Terminated: ok {rc=0} 12:55:59.051974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10824): Launched 12:55:59.373133 run osmo-hlr_10.42.42.2(pid=10825): Launched 12:55:59.496609 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:00.050784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10827): Launched 12:56:00.373081 run osmo-stp_10.42.42.5(pid=10828): Launched 12:56:00.496831 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:56:01.095103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10830): Launched 12:56:01.220901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:56:01.507955 run patchelf(pid=10831): Launched 12:56:01.703153 run osmo-stp_10.42.42.5(pid=10828): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10828)] 12:56:01.841413 run osmo-stp_10.42.42.5(pid=10828): stdout: | (launched: 2022-12-10_12:56:00.313962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:01.981119 run osmo-stp_10.42.42.5(pid=10828): stderr: | [0;m[38;5;43m20221210125600506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125600506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125600506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125600507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125600509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125600509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125600509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:02.120677 run osmo-stp_10.42.42.5(pid=10828): stdout: | (launched: 2022-12-10_12:56:00.313962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:02.254486 run osmo-stp_10.42.42.5(pid=10828): stderr: | [0;m[38;5;43m20221210125600506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125600506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125600506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125600507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125600509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125600509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125600509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:02.426222 run patchelf(pid=10831): Terminating (SIGINT) 12:56:02.621974 run patchelf(pid=10831): Terminated: ok {rc=0} 12:56:02.752604 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10828): Process ended prematurely: osmo-stp_10.42.42.5(pid=10828) [trial-2375↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10828)] [trial-2375↪gprs:oc2g↪cs_paging_gprs_active.py:38] 12:56:02.762770 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 12:56:02.791386 run osmo-hlr_10.42.42.2(pid=10825): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10825)] 12:56:02.841636 run osmo-hlr_10.42.42.2(pid=10825): stdout: | (launched: 2022-12-10_12:55:59.314897) 12:56:02.893461 run osmo-hlr_10.42.42.2(pid=10825): stderr: | [0;m[1;31m20221210125559513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125559513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125559513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125559513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125559513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125559513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125559530 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125559538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125559538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125559538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:02.945929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10818): Terminating (SIGTERM) 12:56:02.987893 run iperf3-srv_10.42.42.10(pid=10819): Terminating (SIGTERM) 12:56:03.030228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10820): Terminating (SIGTERM) 12:56:03.072204 run iperf3-srv_10.42.42.10(pid=10821): Terminating (SIGTERM) 12:56:03.114184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10824): Terminating (SIGTERM) 12:56:03.156095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10827): Terminating (SIGTERM) 12:56:03.198177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10830): Terminating (SIGTERM) 12:56:03.240167 --- ParallelTerminationStrategy: PID 10818 died... 12:56:03.260348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10818): Terminated: ok {rc=0} 12:56:03.306776 --- ParallelTerminationStrategy: PID 10819 died... 12:56:03.326797 run iperf3-srv_10.42.42.10(pid=10819): Terminated {rc=256} 12:56:03.372619 --- ParallelTerminationStrategy: PID 10820 died... 12:56:03.392238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10820): Terminated: ok {rc=0} 12:56:03.438211 --- ParallelTerminationStrategy: PID 10821 died... 12:56:03.457568 run iperf3-srv_10.42.42.10(pid=10821): Terminated {rc=256} 12:56:03.503460 --- ParallelTerminationStrategy: PID 10824 died... 12:56:03.523219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10824): Terminated: ok {rc=0} 12:56:03.568893 --- ParallelTerminationStrategy: PID 10827 died... 12:56:03.588830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10827): Terminated: ok {rc=0} 12:56:03.635207 --- ParallelTerminationStrategy: PID 10830 died... 12:56:03.654767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10830): Terminated: ok {rc=0} 12:56:03.742093 bus /gobi_0: Setting Powered False 12:56:04.840527 bus /gobi_0: Setting Powered False 12:56:05.954658 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g iperf3.py ---------------------------------------------- 12:56:07.103510 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:07.114991 tst gprs:oc2g: Using 1 x bts (candidates: 1) 12:56:07.150697 tst iperf3.py: using LAC 28542 12:56:07.277864 tst iperf3.py: using RAC 237 12:56:07.404752 tst iperf3.py: using CellId 28542 12:56:07.532904 tst iperf3.py: using BVCI 28543 12:56:07.652000 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:07.662984 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:07.673978 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:07.684619 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:07.695174 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:07.705934 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:07.716688 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:07.727689 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:07.738688 tst gprs:oc2g: Using 1 x modem (candidates: 4) 12:56:07.855157 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:56:08.057895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:56:08.359927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10832): Launched 12:56:08.622293 run iperf3-srv_10.42.42.10(pid=10833): Launched 12:56:08.735060 tst iperf3.py:8: start network... 12:56:08.937077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:09.402957 run create_hlr_db(pid=10834): Launched 12:56:09.518214 bus /gobi_6: Setting Powered False 12:56:10.578195 run create_hlr_db(pid=10834): Terminated: ok {rc=0} 12:56:11.018175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10836): Launched 12:56:11.338376 run osmo-hlr_10.42.42.2(pid=10837): Launched 12:56:11.461351 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:12.015231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10839): Launched 12:56:12.337328 run osmo-stp_10.42.42.5(pid=10840): Launched 12:56:12.461442 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:56:13.018220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10842): Launched 12:56:13.140575 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:56:13.412009 run patchelf(pid=10843): Launched 12:56:13.590530 run osmo-stp_10.42.42.5(pid=10840): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10840)] 12:56:13.726763 run osmo-stp_10.42.42.5(pid=10840): stdout: | (launched: 2022-12-10_12:56:12.278331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:13.864296 run osmo-stp_10.42.42.5(pid=10840): stderr: | [0;m[38;5;43m20221210125612473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125612473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125612473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125612474 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125612474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125612474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125612474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:14.002176 run osmo-stp_10.42.42.5(pid=10840): stdout: | (launched: 2022-12-10_12:56:12.278331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:14.133966 run osmo-stp_10.42.42.5(pid=10840): stderr: | [0;m[38;5;43m20221210125612473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125612473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125612473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125612474 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125612474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125612474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125612474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:14.290161 run patchelf(pid=10843): Terminating (SIGINT) 12:56:14.471720 run patchelf(pid=10843): Terminated: ok {rc=0} 12:56:14.601747 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10840): Process ended prematurely: osmo-stp_10.42.42.5(pid=10840) [trial-2375↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10840)] [trial-2375↪gprs:oc2g↪iperf3.py:8] 12:56:14.611700 tst iperf3.py:8: Test FAILED (7.5 sec) 12:56:14.640279 run osmo-hlr_10.42.42.2(pid=10837): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10837)] 12:56:14.689963 run osmo-hlr_10.42.42.2(pid=10837): stdout: | (launched: 2022-12-10_12:56:11.280017) 12:56:14.741490 run osmo-hlr_10.42.42.2(pid=10837): stderr: | [0;m[1;31m20221210125611480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125611480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125611480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125611480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125611480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125611480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125611492 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125611500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125611501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125611501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:14.793680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10832): Terminating (SIGTERM) 12:56:14.835362 run iperf3-srv_10.42.42.10(pid=10833): Terminating (SIGTERM) 12:56:14.878417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10836): Terminating (SIGTERM) 12:56:14.920201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10839): Terminating (SIGTERM) 12:56:14.961544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10842): Terminating (SIGTERM) 12:56:15.003238 --- ParallelTerminationStrategy: PID 10832 died... 12:56:15.023086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10832): Terminated: ok {rc=0} 12:56:15.068838 --- ParallelTerminationStrategy: PID 10833 died... 12:56:15.088180 run iperf3-srv_10.42.42.10(pid=10833): Terminated {rc=256} 12:56:15.133701 --- ParallelTerminationStrategy: PID 10836 died... 12:56:15.153092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10836): Terminated: ok {rc=0} 12:56:15.198800 --- ParallelTerminationStrategy: PID 10839 died... 12:56:15.218180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10839): Terminated: ok {rc=0} 12:56:15.263657 --- ParallelTerminationStrategy: PID 10842 died... 12:56:15.282987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10842): Terminated: ok {rc=0} 12:56:15.369077 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g iperf3m4.py ---------------------------------------------- 12:56:16.523400 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:16.535752 tst gprs:oc2g: Using 1 x bts (candidates: 1) 12:56:16.572410 tst iperf3m4.py: using LAC 28543 12:56:16.695217 tst iperf3m4.py: using RAC 238 12:56:16.815677 tst iperf3m4.py: using CellId 28543 12:56:16.947529 tst iperf3m4.py: using BVCI 28544 12:56:17.107197 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:17.122169 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:17.137770 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:17.159067 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:17.172530 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:17.183483 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:17.196045 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:17.207984 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:17.219297 tst gprs:oc2g: Using 1 x modem (candidates: 4) 12:56:17.338281 tst gprs:oc2g: Using 1 x modem (candidates: 4) 12:56:17.458138 tst gprs:oc2g: Using 1 x modem (candidates: 4) 12:56:17.579463 tst gprs:oc2g: Using 1 x modem (candidates: 4) 12:56:17.694067 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:56:17.895990 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:56:18.199281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10844): Launched 12:56:18.465585 run iperf3-srv_10.42.42.10(pid=10845): Launched 12:56:18.579808 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:56:18.782780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:56:19.086080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10846): Launched 12:56:19.347711 run iperf3-srv_10.42.42.10(pid=10847): Launched 12:56:19.461113 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:56:19.663444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:56:19.965164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10848): Launched 12:56:20.226274 run iperf3-srv_10.42.42.10(pid=10849): Launched 12:56:20.338563 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:56:20.539343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:56:20.840101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10850): Launched 12:56:21.101999 run iperf3-srv_10.42.42.10(pid=10851): Launched 12:56:21.214562 tst iperf3m4.py:8: start network... 12:56:21.415245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:21.881038 run create_hlr_db(pid=10852): Launched 12:56:21.996104 bus /gobi_6: Setting Powered False 12:56:23.055217 run create_hlr_db(pid=10852): Terminated: ok {rc=0} 12:56:23.473300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10854): Launched 12:56:23.773782 run osmo-hlr_10.42.42.2(pid=10855): Launched 12:56:23.889175 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:24.404811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10857): Launched 12:56:24.705538 run osmo-stp_10.42.42.5(pid=10858): Launched 12:56:24.821882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:56:25.345279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10860): Launched 12:56:25.460317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:56:25.714601 run patchelf(pid=10861): Launched 12:56:25.881422 run osmo-stp_10.42.42.5(pid=10858): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10858)] 12:56:26.008222 run osmo-stp_10.42.42.5(pid=10858): stdout: | (launched: 2022-12-10_12:56:24.650509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:26.137078 run osmo-stp_10.42.42.5(pid=10858): stderr: | [0;m[38;5;43m20221210125624819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125624820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125624820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125624820 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125624822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125624823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125624823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:26.266153 run osmo-stp_10.42.42.5(pid=10858): stdout: | (launched: 2022-12-10_12:56:24.650509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:26.389399 run osmo-stp_10.42.42.5(pid=10858): stderr: | [0;m[38;5;43m20221210125624819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125624820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125624820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125624820 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125624822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125624823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125624823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:26.535827 run patchelf(pid=10861): Terminating (SIGINT) 12:56:26.705418 run patchelf(pid=10861): Terminated: ok {rc=0} 12:56:26.826937 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10858): Process ended prematurely: osmo-stp_10.42.42.5(pid=10858) [trial-2375↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10858)] [trial-2375↪gprs:oc2g↪iperf3m4.py:8] 12:56:26.836264 tst iperf3m4.py:8: Test FAILED (10.4 sec) 12:56:26.863837 run osmo-hlr_10.42.42.2(pid=10855): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10855)] 12:56:26.911705 run osmo-hlr_10.42.42.2(pid=10855): stdout: | (launched: 2022-12-10_12:56:23.718368) 12:56:26.960854 run osmo-hlr_10.42.42.2(pid=10855): stderr: | [0;m[1;31m20221210125623896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125623896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125623896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125623896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125623896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125623896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125623907 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125623915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125623915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125623916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:27.010565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10844): Terminating (SIGTERM) 12:56:27.050347 run iperf3-srv_10.42.42.10(pid=10845): Terminating (SIGTERM) 12:56:27.089808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10846): Terminating (SIGTERM) 12:56:27.129576 run iperf3-srv_10.42.42.10(pid=10847): Terminating (SIGTERM) 12:56:27.169123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10848): Terminating (SIGTERM) 12:56:27.208671 run iperf3-srv_10.42.42.10(pid=10849): Terminating (SIGTERM) 12:56:27.248575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10850): Terminating (SIGTERM) 12:56:27.288320 run iperf3-srv_10.42.42.10(pid=10851): Terminating (SIGTERM) 12:56:27.327794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10854): Terminating (SIGTERM) 12:56:27.367506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10857): Terminating (SIGTERM) 12:56:27.407230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10860): Terminating (SIGTERM) 12:56:27.447355 --- ParallelTerminationStrategy: PID 10844 died... 12:56:27.466369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10844): Terminated: ok {rc=0} 12:56:27.510476 --- ParallelTerminationStrategy: PID 10845 died... 12:56:27.529050 run iperf3-srv_10.42.42.10(pid=10845): Terminated {rc=256} 12:56:27.573139 --- ParallelTerminationStrategy: PID 10846 died... 12:56:27.591613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10846): Terminated: ok {rc=0} 12:56:27.636151 --- ParallelTerminationStrategy: PID 10847 died... 12:56:27.654650 run iperf3-srv_10.42.42.10(pid=10847): Terminated {rc=256} 12:56:27.698521 --- ParallelTerminationStrategy: PID 10848 died... 12:56:27.716915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10848): Terminated: ok {rc=0} 12:56:27.761198 --- ParallelTerminationStrategy: PID 10849 died... 12:56:27.779714 run iperf3-srv_10.42.42.10(pid=10849): Terminated {rc=256} 12:56:27.823946 --- ParallelTerminationStrategy: PID 10850 died... 12:56:27.842482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10850): Terminated: ok {rc=0} 12:56:27.886543 --- ParallelTerminationStrategy: PID 10851 died... 12:56:27.905056 run iperf3-srv_10.42.42.10(pid=10851): Terminated {rc=256} 12:56:27.949724 --- ParallelTerminationStrategy: PID 10854 died... 12:56:27.968060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10854): Terminated: ok {rc=0} 12:56:28.012080 --- ParallelTerminationStrategy: PID 10857 died... 12:56:28.030620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10857): Terminated: ok {rc=0} 12:56:28.074636 --- ParallelTerminationStrategy: PID 10860 died... 12:56:28.093094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10860): Terminated: ok {rc=0} 12:56:28.178727 bus /gobi_4: Setting Powered False 12:56:29.278850 bus /gobi_4: Setting Powered False 12:56:30.393686 bus /gobi_1: Setting Powered False 12:56:31.491812 bus /gobi_1: Setting Powered False 12:56:32.609611 bus /gobi_0: Setting Powered False 12:56:33.708080 bus /gobi_0: Setting Powered False 12:56:34.824375 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g ping.py ---------------------------------------------- 12:56:35.927175 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:35.938717 tst gprs:oc2g: Using 1 x bts (candidates: 1) 12:56:35.974434 tst ping.py: using LAC 28544 12:56:36.093641 tst ping.py: using RAC 239 12:56:36.213130 tst ping.py: using CellId 28544 12:56:36.339796 tst ping.py: using BVCI 28545 12:56:36.455889 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:36.466679 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:36.477697 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:36.488308 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:36.498836 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:36.509467 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:36.520115 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:36.530738 tst gprs:oc2g: Using 1 x modem (candidates: 4) 12:56:36.645460 tst ping.py:19: start network... 12:56:36.843275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:37.298402 run create_hlr_db(pid=10862): Launched 12:56:37.411655 bus /gobi_6: Setting Powered False 12:56:38.470209 run create_hlr_db(pid=10862): Terminated: ok {rc=0} 12:56:38.901490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10864): Launched 12:56:39.217439 run osmo-hlr_10.42.42.2(pid=10865): Launched 12:56:39.338800 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:39.886902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10867): Launched 12:56:40.202713 run osmo-stp_10.42.42.5(pid=10868): Launched 12:56:40.323533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:56:40.870081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10870): Launched 12:56:40.990470 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:56:41.257688 run patchelf(pid=10871): Launched 12:56:41.433380 run osmo-stp_10.42.42.5(pid=10868): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10868)] 12:56:41.567784 run osmo-stp_10.42.42.5(pid=10868): stdout: | (launched: 2022-12-10_12:56:40.145064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:41.704555 run osmo-stp_10.42.42.5(pid=10868): stderr: | [0;m[38;5;43m20221210125640335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125640335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125640335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125640336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125640336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125640336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125640336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:41.840334 run osmo-stp_10.42.42.5(pid=10868): stdout: | (launched: 2022-12-10_12:56:40.145064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:41.971098 run osmo-stp_10.42.42.5(pid=10868): stderr: | [0;m[38;5;43m20221210125640335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125640335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125640335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125640336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125640336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125640336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125640336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:42.125817 run patchelf(pid=10871): Terminating (SIGINT) 12:56:42.304642 run patchelf(pid=10871): Terminated: ok {rc=0} 12:56:42.433634 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10868): Process ended prematurely: osmo-stp_10.42.42.5(pid=10868) [trial-2375↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10868)] [trial-2375↪gprs:oc2g↪ping.py:22] 12:56:42.442971 tst ping.py:22: Test FAILED (6.5 sec) 12:56:42.471215 run osmo-hlr_10.42.42.2(pid=10865): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10865)] 12:56:42.521714 run osmo-hlr_10.42.42.2(pid=10865): stdout: | (launched: 2022-12-10_12:56:39.159736) 12:56:42.573522 run osmo-hlr_10.42.42.2(pid=10865): stderr: | [0;m[1;31m20221210125639356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125639356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125639356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125639357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125639357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125639357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125639367 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125639375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125639375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125639376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:42.625602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10864): Terminating (SIGTERM) 12:56:42.668377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10867): Terminating (SIGTERM) 12:56:42.710557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10870): Terminating (SIGTERM) 12:56:42.752704 --- ParallelTerminationStrategy: PID 10864 died... 12:56:42.772760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10864): Terminated: ok {rc=0} 12:56:42.818818 --- ParallelTerminationStrategy: PID 10867 died... 12:56:42.838352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10867): Terminated: ok {rc=0} 12:56:42.884368 --- ParallelTerminationStrategy: PID 10870 died... 12:56:42.903899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10870): Terminated: ok {rc=0} 12:56:42.991330 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 12:56:44.077805 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:44.089404 tst gprs:oc2g: Using 1 x bts (candidates: 1) 12:56:44.125670 tst ping_idle_ping.py: using LAC 28545 12:56:44.250448 tst ping_idle_ping.py: using RAC 240 12:56:44.376229 tst ping_idle_ping.py: using CellId 28545 12:56:44.504858 tst ping_idle_ping.py: using BVCI 28546 12:56:44.622578 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:44.633457 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:44.644474 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:44.655396 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:44.666145 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:44.676849 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:44.687802 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:56:44.698475 tst gprs:oc2g: Using 1 x modem (candidates: 4) 12:56:44.814480 tst ping_idle_ping.py:24: start network... 12:56:45.027678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:45.520088 run create_hlr_db(pid=10872): Launched 12:56:45.649702 bus /gobi_6: Setting Powered False 12:56:46.728609 run create_hlr_db(pid=10872): Terminated: ok {rc=0} 12:56:47.225069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10874): Launched 12:56:47.533696 run osmo-hlr_10.42.42.2(pid=10875): Launched 12:56:47.647309 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:48.171653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10877): Launched 12:56:48.468802 run osmo-stp_10.42.42.5(pid=10878): Launched 12:56:48.582038 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:56:49.111304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10880): Launched 12:56:49.224449 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:56:49.474904 run patchelf(pid=10881): Launched 12:56:49.640169 run osmo-stp_10.42.42.5(pid=10878): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10878)] 12:56:49.766074 run osmo-stp_10.42.42.5(pid=10878): stdout: | (launched: 2022-12-10_12:56:48.414096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:49.893387 run osmo-stp_10.42.42.5(pid=10878): stderr: | [0;m[38;5;43m20221210125648586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125648586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125648586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125648586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125648587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125648587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125648587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:50.020497 run osmo-stp_10.42.42.5(pid=10878): stdout: | (launched: 2022-12-10_12:56:48.414096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:50.142687 run osmo-stp_10.42.42.5(pid=10878): stderr: | [0;m[38;5;43m20221210125648586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125648586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125648586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125648586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125648587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125648587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125648587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:50.287416 run patchelf(pid=10881): Terminating (SIGINT) 12:56:50.455172 run patchelf(pid=10881): Terminated: ok {rc=0} 12:56:50.575870 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10878): Process ended prematurely: osmo-stp_10.42.42.5(pid=10878) [trial-2375↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10878)] [trial-2375↪gprs:oc2g↪ping_idle_ping.py:27] 12:56:50.584698 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 12:56:50.611973 run osmo-hlr_10.42.42.2(pid=10875): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10875)] 12:56:50.659609 run osmo-hlr_10.42.42.2(pid=10875): stdout: | (launched: 2022-12-10_12:56:47.479265) 12:56:50.709268 run osmo-hlr_10.42.42.2(pid=10875): stderr: | [0;m[1;31m20221210125647654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125647654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125647654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125647654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125647654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125647654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125647666 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125647676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125647677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125647677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:50.759068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10874): Terminating (SIGTERM) 12:56:50.799487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10877): Terminating (SIGTERM) 12:56:50.839629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10880): Terminating (SIGTERM) 12:56:50.879881 --- ParallelTerminationStrategy: PID 10874 died... 12:56:50.898902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10874): Terminated: ok {rc=0} 12:56:50.943501 --- ParallelTerminationStrategy: PID 10877 died... 12:56:50.962153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10877): Terminated: ok {rc=0} 12:56:51.006222 --- ParallelTerminationStrategy: PID 10880 died... 12:56:51.024780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10880): Terminated: ok {rc=0} 12:56:51.110974 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 12:56:52.395021 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:52.400509 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:56:52.421454 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:56:52.459245 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:56:52.544627 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:56:52.564743 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:56:52.602970 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:56:53.193304 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:56:53.241818 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:56:53.252477 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:56:53.289250 tst cs_paging_gprs_active.py: using LAC 28546 12:56:53.408691 tst cs_paging_gprs_active.py: using RAC 241 12:56:53.525867 tst cs_paging_gprs_active.py: using CellId 28546 12:56:53.643088 tst cs_paging_gprs_active.py: using BVCI 28547 12:56:53.753137 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:56:53.763558 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:56:53.773992 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:56:53.784706 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:56:53.795487 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:56:53.806791 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:56:53.817893 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:56:53.828538 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:56:53.839482 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:56:53.955995 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:56:54.069480 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:56:54.269180 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:56:54.566581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10885): Launched 12:56:54.824742 run iperf3-srv_10.42.42.10(pid=10886): Launched 12:56:54.936137 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:56:55.134355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:56:55.430688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10887): Launched 12:56:55.688390 run iperf3-srv_10.42.42.10(pid=10888): Launched 12:56:55.799858 tst cs_paging_gprs_active.py:38: start network... 12:56:55.997864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:56.458664 run create_hlr_db(pid=10889): Launched 12:56:56.571908 bus /gobi_6: Setting Powered False 12:56:57.631625 run create_hlr_db(pid=10889): Terminated: ok {rc=0} 12:56:58.064036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10891): Launched 12:56:58.379311 run osmo-hlr_10.42.42.2(pid=10892): Launched 12:56:58.500155 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:59.047514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10894): Launched 12:56:59.363034 run osmo-stp_10.42.42.5(pid=10895): Launched 12:56:59.484335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:57:00.031201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10897): Launched 12:57:00.152129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:57:00.419677 run patchelf(pid=10898): Launched 12:57:00.595511 run osmo-stp_10.42.42.5(pid=10895): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10895)] 12:57:00.730193 run osmo-stp_10.42.42.5(pid=10895): stdout: | (launched: 2022-12-10_12:56:59.305726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:00.872164 run osmo-stp_10.42.42.5(pid=10895): stderr: | [0;m[38;5;43m20221210125659495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125659495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125659495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125659496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125659496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125659496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125659496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:01.020782 run osmo-stp_10.42.42.5(pid=10895): stdout: | (launched: 2022-12-10_12:56:59.305726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:01.154143 run osmo-stp_10.42.42.5(pid=10895): stderr: | [0;m[38;5;43m20221210125659495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125659495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125659495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125659496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125659496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125659496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125659496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:01.311154 run patchelf(pid=10898): Terminating (SIGINT) 12:57:01.492207 run patchelf(pid=10898): Terminated: ok {rc=0} 12:57:01.622967 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10895): Process ended prematurely: osmo-stp_10.42.42.5(pid=10895) [trial-2375↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10895)] [trial-2375↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:57:01.633555 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 12:57:01.662826 run osmo-hlr_10.42.42.2(pid=10892): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10892)] 12:57:01.713648 run osmo-hlr_10.42.42.2(pid=10892): stdout: | (launched: 2022-12-10_12:56:58.322337) 12:57:01.765907 run osmo-hlr_10.42.42.2(pid=10892): stderr: | [0;m[1;31m20221210125658520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125658520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125658520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125658520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125658520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125658520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125658533 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125658541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125658541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125658541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:01.818577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10885): Terminating (SIGTERM) 12:57:01.861319 run iperf3-srv_10.42.42.10(pid=10886): Terminating (SIGTERM) 12:57:01.906508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10887): Terminating (SIGTERM) 12:57:01.949534 run iperf3-srv_10.42.42.10(pid=10888): Terminating (SIGTERM) 12:57:01.994470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10891): Terminating (SIGTERM) 12:57:02.037656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10894): Terminating (SIGTERM) 12:57:02.081084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10897): Terminating (SIGTERM) 12:57:02.123465 --- ParallelTerminationStrategy: PID 10885 died... 12:57:02.143074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10885): Terminated: ok {rc=0} 12:57:02.189231 --- ParallelTerminationStrategy: PID 10886 died... 12:57:02.208460 run iperf3-srv_10.42.42.10(pid=10886): Terminated {rc=256} 12:57:02.253555 --- ParallelTerminationStrategy: PID 10887 died... 12:57:02.272435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10887): Terminated: ok {rc=0} 12:57:02.317504 --- ParallelTerminationStrategy: PID 10888 died... 12:57:02.336419 run iperf3-srv_10.42.42.10(pid=10888): Terminated {rc=256} 12:57:02.381449 --- ParallelTerminationStrategy: PID 10891 died... 12:57:02.400271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10891): Terminated: ok {rc=0} 12:57:02.445539 --- ParallelTerminationStrategy: PID 10894 died... 12:57:02.464664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10894): Terminated: ok {rc=0} 12:57:02.510028 --- ParallelTerminationStrategy: PID 10897 died... 12:57:02.529441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10897): Terminated: ok {rc=0} 12:57:02.616237 bus /gobi_0: Setting Powered False 12:57:03.715126 bus /gobi_0: Setting Powered False 12:57:04.830919 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:57:05.980281 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:05.991952 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:57:06.029865 tst iperf3.py: using LAC 28547 12:57:06.156102 tst iperf3.py: using RAC 242 12:57:06.275374 tst iperf3.py: using CellId 28547 12:57:06.394110 tst iperf3.py: using BVCI 28548 12:57:06.502942 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:06.513676 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:06.524334 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:06.535414 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:06.546367 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:06.557275 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:06.568237 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:06.578834 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:06.590242 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:57:06.710547 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:57:06.923502 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:57:07.239183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10899): Launched 12:57:07.512416 run iperf3-srv_10.42.42.10(pid=10900): Launched 12:57:07.630566 tst iperf3.py:8: start network... 12:57:07.842820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:08.330884 run create_hlr_db(pid=10901): Launched 12:57:08.459377 bus /gobi_6: Setting Powered False 12:57:09.521650 run create_hlr_db(pid=10901): Terminated: ok {rc=0} 12:57:09.941648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10903): Launched 12:57:10.236222 run osmo-hlr_10.42.42.2(pid=10904): Launched 12:57:10.349787 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:10.858771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10906): Launched 12:57:11.153714 run osmo-stp_10.42.42.5(pid=10919): Launched 12:57:11.266771 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:57:11.777136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10921): Launched 12:57:11.890219 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:57:12.140264 run patchelf(pid=10922): Launched 12:57:12.305512 run osmo-stp_10.42.42.5(pid=10919): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10919)] 12:57:12.431155 run osmo-stp_10.42.42.5(pid=10919): stdout: | (launched: 2022-12-10_12:57:11.100126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:12.558390 run osmo-stp_10.42.42.5(pid=10919): stderr: | [0;m[38;5;43m20221210125711269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125711269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125711270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125711270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125711270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125711271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125711271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:12.685821 run osmo-stp_10.42.42.5(pid=10919): stdout: | (launched: 2022-12-10_12:57:11.100126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:12.807689 run osmo-stp_10.42.42.5(pid=10919): stderr: | [0;m[38;5;43m20221210125711269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125711269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125711270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125711270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125711270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125711271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125711271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:12.953050 run patchelf(pid=10922): Terminating (SIGINT) 12:57:13.119748 run patchelf(pid=10922): Terminated: ok {rc=0} 12:57:13.240304 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10919): Process ended prematurely: osmo-stp_10.42.42.5(pid=10919) [trial-2375↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10919)] [trial-2375↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 12:57:13.249656 tst iperf3.py:8: Test FAILED (7.3 sec) 12:57:13.276849 run osmo-hlr_10.42.42.2(pid=10904): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10904)] 12:57:13.324394 run osmo-hlr_10.42.42.2(pid=10904): stdout: | (launched: 2022-12-10_12:57:10.182128) 12:57:13.373596 run osmo-hlr_10.42.42.2(pid=10904): stderr: | [0;m[1;31m20221210125710356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125710356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125710356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125710356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125710356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125710356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125710368 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125710378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125710378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125710378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:13.423069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10899): Terminating (SIGTERM) 12:57:13.462555 run iperf3-srv_10.42.42.10(pid=10900): Terminating (SIGTERM) 12:57:13.501948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10903): Terminating (SIGTERM) 12:57:13.541635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10906): Terminating (SIGTERM) 12:57:13.581231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10921): Terminating (SIGTERM) 12:57:13.621031 --- ParallelTerminationStrategy: PID 10899 died... 12:57:13.639852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10899): Terminated: ok {rc=0} 12:57:13.683928 --- ParallelTerminationStrategy: PID 10900 died... 12:57:13.702267 run iperf3-srv_10.42.42.10(pid=10900): Terminated {rc=256} 12:57:13.746101 --- ParallelTerminationStrategy: PID 10903 died... 12:57:13.764511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10903): Terminated: ok {rc=0} 12:57:13.808491 --- ParallelTerminationStrategy: PID 10906 died... 12:57:13.826895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10906): Terminated: ok {rc=0} 12:57:13.871099 --- ParallelTerminationStrategy: PID 10921 died... 12:57:13.889497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10921): Terminated: ok {rc=0} 12:57:13.974738 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:57:15.118841 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:15.130146 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:57:15.166717 tst iperf3m4.py: using LAC 28548 12:57:15.283984 tst iperf3m4.py: using RAC 243 12:57:15.400713 tst iperf3m4.py: using CellId 28548 12:57:15.518205 tst iperf3m4.py: using BVCI 28549 12:57:15.628254 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:15.639048 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:15.649751 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:15.660352 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:15.670995 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:15.681540 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:15.692294 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:15.702780 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:15.713736 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:57:15.833262 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:57:15.968308 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:57:16.088495 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:57:16.227980 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:57:16.458156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:57:16.846805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10923): Launched 12:57:17.134071 run iperf3-srv_10.42.42.10(pid=10924): Launched 12:57:17.266508 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:57:17.467360 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:57:17.765828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10925): Launched 12:57:18.022733 run iperf3-srv_10.42.42.10(pid=10926): Launched 12:57:18.133998 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:57:18.331780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:57:18.628553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10927): Launched 12:57:18.886352 run iperf3-srv_10.42.42.10(pid=10928): Launched 12:57:18.998284 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:57:19.196319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:57:19.493756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10929): Launched 12:57:19.752704 run iperf3-srv_10.42.42.10(pid=10930): Launched 12:57:19.863908 tst iperf3m4.py:8: start network... 12:57:20.062154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:20.522419 run create_hlr_db(pid=10931): Launched 12:57:20.635245 bus /gobi_6: Setting Powered False 12:57:21.694393 run create_hlr_db(pid=10931): Terminated: ok {rc=0} 12:57:22.106921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10933): Launched 12:57:22.402772 run osmo-hlr_10.42.42.2(pid=10934): Launched 12:57:22.516549 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:23.043262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10936): Launched 12:57:23.339965 run osmo-stp_10.42.42.5(pid=10937): Launched 12:57:23.453953 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:57:23.968765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10939): Launched 12:57:24.091062 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:57:24.358482 run patchelf(pid=10940): Launched 12:57:24.535718 run osmo-stp_10.42.42.5(pid=10937): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10937)] 12:57:24.670656 run osmo-stp_10.42.42.5(pid=10937): stdout: | (launched: 2022-12-10_12:57:23.285853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:24.806549 run osmo-stp_10.42.42.5(pid=10937): stderr: | [0;m[38;5;43m20221210125723455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125723455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125723455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125723456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125723456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125723456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125723456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:24.942521 run osmo-stp_10.42.42.5(pid=10937): stdout: | (launched: 2022-12-10_12:57:23.285853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:25.073813 run osmo-stp_10.42.42.5(pid=10937): stderr: | [0;m[38;5;43m20221210125723455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125723455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125723455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125723456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125723456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125723456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125723456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:25.227872 run patchelf(pid=10940): Terminating (SIGINT) 12:57:25.406279 run patchelf(pid=10940): Terminated: ok {rc=0} 12:57:25.534704 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10937): Process ended prematurely: osmo-stp_10.42.42.5(pid=10937) [trial-2375↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10937)] [trial-2375↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 12:57:25.544680 tst iperf3m4.py:8: Test FAILED (10.5 sec) 12:57:25.573233 run osmo-hlr_10.42.42.2(pid=10934): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10934)] 12:57:25.622724 run osmo-hlr_10.42.42.2(pid=10934): stdout: | (launched: 2022-12-10_12:57:22.348737) 12:57:25.674284 run osmo-hlr_10.42.42.2(pid=10934): stderr: | [0;m[1;31m20221210125722524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125722524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125722524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125722524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125722524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125722525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125722537 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125722545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125722546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125722546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:25.725977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10923): Terminating (SIGTERM) 12:57:25.767442 run iperf3-srv_10.42.42.10(pid=10924): Terminating (SIGTERM) 12:57:25.810517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10925): Terminating (SIGTERM) 12:57:25.852327 run iperf3-srv_10.42.42.10(pid=10926): Terminating (SIGTERM) 12:57:25.893804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10927): Terminating (SIGTERM) 12:57:25.935175 run iperf3-srv_10.42.42.10(pid=10928): Terminating (SIGTERM) 12:57:25.976451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10929): Terminating (SIGTERM) 12:57:26.017874 run iperf3-srv_10.42.42.10(pid=10930): Terminating (SIGTERM) 12:57:26.059180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10933): Terminating (SIGTERM) 12:57:26.100681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10936): Terminating (SIGTERM) 12:57:26.142241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10939): Terminating (SIGTERM) 12:57:26.183936 --- ParallelTerminationStrategy: PID 10923 died... 12:57:26.203655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10923): Terminated: ok {rc=0} 12:57:26.249663 --- ParallelTerminationStrategy: PID 10924 died... 12:57:26.269093 run iperf3-srv_10.42.42.10(pid=10924): Terminated {rc=256} 12:57:26.314755 --- ParallelTerminationStrategy: PID 10925 died... 12:57:26.334088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10925): Terminated: ok {rc=0} 12:57:26.379523 --- ParallelTerminationStrategy: PID 10926 died... 12:57:26.398810 run iperf3-srv_10.42.42.10(pid=10926): Terminated {rc=256} 12:57:26.444340 --- ParallelTerminationStrategy: PID 10927 died... 12:57:26.463607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10927): Terminated: ok {rc=0} 12:57:26.508707 --- ParallelTerminationStrategy: PID 10928 died... 12:57:26.527964 run iperf3-srv_10.42.42.10(pid=10928): Terminated {rc=256} 12:57:26.573105 --- ParallelTerminationStrategy: PID 10929 died... 12:57:26.592314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10929): Terminated: ok {rc=0} 12:57:26.637732 --- ParallelTerminationStrategy: PID 10930 died... 12:57:26.657092 run iperf3-srv_10.42.42.10(pid=10930): Terminated {rc=256} 12:57:26.702459 --- ParallelTerminationStrategy: PID 10933 died... 12:57:26.721861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10933): Terminated: ok {rc=0} 12:57:26.767162 --- ParallelTerminationStrategy: PID 10936 died... 12:57:26.786476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10936): Terminated: ok {rc=0} 12:57:26.831925 --- ParallelTerminationStrategy: PID 10939 died... 12:57:26.851261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10939): Terminated: ok {rc=0} 12:57:26.937281 bus /gobi_4: Setting Powered False 12:57:28.034581 bus /gobi_4: Setting Powered False 12:57:29.148909 bus /gobi_1: Setting Powered False 12:57:30.245617 bus /gobi_1: Setting Powered False 12:57:31.365966 bus /gobi_0: Setting Powered False 12:57:32.473637 bus /gobi_0: Setting Powered False 12:57:33.589981 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 12:57:34.691706 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:34.703004 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:57:34.739862 tst ping.py: using LAC 28549 12:57:34.858658 tst ping.py: using RAC 244 12:57:34.978172 tst ping.py: using CellId 28549 12:57:35.093858 tst ping.py: using BVCI 28550 12:57:35.200040 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:35.210626 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:35.221274 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:35.231885 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:35.242469 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:35.253094 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:35.263794 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:35.274615 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:57:35.391578 tst ping.py:19: start network... 12:57:35.601159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:36.084251 run create_hlr_db(pid=10944): Launched 12:57:36.209879 bus /gobi_6: Setting Powered False 12:57:37.271233 run create_hlr_db(pid=10944): Terminated: ok {rc=0} 12:57:37.687372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10946): Launched 12:57:37.978971 run osmo-hlr_10.42.42.2(pid=10947): Launched 12:57:38.090240 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:38.592355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10949): Launched 12:57:38.883516 run osmo-stp_10.42.42.5(pid=10950): Launched 12:57:38.995036 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:57:39.497407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10952): Launched 12:57:39.609807 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:57:39.857379 run patchelf(pid=10953): Launched 12:57:40.021747 run osmo-stp_10.42.42.5(pid=10950): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10950)] 12:57:40.146675 run osmo-stp_10.42.42.5(pid=10950): stdout: | (launched: 2022-12-10_12:57:38.829980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:40.272801 run osmo-stp_10.42.42.5(pid=10950): stderr: | [0;m[38;5;43m20221210125738999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125738999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125738999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125738999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125739000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125739000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125739000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:40.399248 run osmo-stp_10.42.42.5(pid=10950): stdout: | (launched: 2022-12-10_12:57:38.829980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:40.520213 run osmo-stp_10.42.42.5(pid=10950): stderr: | [0;m[38;5;43m20221210125738999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125738999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125738999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125738999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125739000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125739000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125739000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:40.663726 run patchelf(pid=10953): Terminating (SIGINT) 12:57:40.830544 run patchelf(pid=10953): Terminated: ok {rc=0} 12:57:40.950879 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10950): Process ended prematurely: osmo-stp_10.42.42.5(pid=10950) [trial-2375↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10950)] [trial-2375↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 12:57:40.959455 tst ping.py:22: Test FAILED (6.3 sec) 12:57:40.986277 run osmo-hlr_10.42.42.2(pid=10947): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10947)] 12:57:41.033838 run osmo-hlr_10.42.42.2(pid=10947): stdout: | (launched: 2022-12-10_12:57:37.925953) 12:57:41.082841 run osmo-hlr_10.42.42.2(pid=10947): stderr: | [0;m[1;31m20221210125738101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125738101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125738101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125738101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125738101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125738101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125738113 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125738121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125738121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125738121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:41.132693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10946): Terminating (SIGTERM) 12:57:41.172151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10949): Terminating (SIGTERM) 12:57:41.211775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10952): Terminating (SIGTERM) 12:57:41.251322 --- ParallelTerminationStrategy: PID 10946 died... 12:57:41.270110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10946): Terminated: ok {rc=0} 12:57:41.314057 --- ParallelTerminationStrategy: PID 10949 died... 12:57:41.332653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10949): Terminated: ok {rc=0} 12:57:41.376422 --- ParallelTerminationStrategy: PID 10952 died... 12:57:41.394933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10952): Terminated: ok {rc=0} 12:57:41.479447 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:57:42.567888 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:42.579491 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:57:42.617808 tst ping_idle_ping.py: using LAC 28550 12:57:42.734505 tst ping_idle_ping.py: using RAC 245 12:57:42.853199 tst ping_idle_ping.py: using CellId 28550 12:57:42.977793 tst ping_idle_ping.py: using BVCI 28551 12:57:43.092862 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:43.104041 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:43.115359 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:43.126493 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:43.137813 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:43.148501 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:43.159540 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:57:43.170377 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:57:43.287413 tst ping_idle_ping.py:24: start network... 12:57:43.498206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:43.985172 run create_hlr_db(pid=10954): Launched 12:57:44.111499 bus /gobi_6: Setting Powered False 12:57:45.174854 run create_hlr_db(pid=10954): Terminated: ok {rc=0} 12:57:45.611781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10956): Launched 12:57:45.950874 run osmo-hlr_10.42.42.2(pid=10957): Launched 12:57:46.182377 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:46.863876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10959): Launched 12:57:47.188198 run osmo-stp_10.42.42.5(pid=10960): Launched 12:57:47.351237 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:57:47.894085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10962): Launched 12:57:48.013508 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:57:48.277696 run patchelf(pid=10963): Launched 12:57:48.452711 run osmo-stp_10.42.42.5(pid=10960): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10960)] 12:57:48.586107 run osmo-stp_10.42.42.5(pid=10960): stdout: | (launched: 2022-12-10_12:57:47.124097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:48.721595 run osmo-stp_10.42.42.5(pid=10960): stderr: | [0;m[38;5;43m20221210125747364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125747364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125747364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125747365 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125747365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125747365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125747365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:48.856372 run osmo-stp_10.42.42.5(pid=10960): stdout: | (launched: 2022-12-10_12:57:47.124097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:48.986200 run osmo-stp_10.42.42.5(pid=10960): stderr: | [0;m[38;5;43m20221210125747364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125747364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125747364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125747365 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125747365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125747365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125747365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:49.139716 run patchelf(pid=10963): Terminating (SIGINT) 12:57:49.317193 run patchelf(pid=10963): Terminated: ok {rc=0} 12:57:49.444893 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10960): Process ended prematurely: osmo-stp_10.42.42.5(pid=10960) [trial-2375↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10960)] [trial-2375↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 12:57:49.454370 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 12:57:49.482328 run osmo-hlr_10.42.42.2(pid=10957): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10957)] 12:57:49.532215 run osmo-hlr_10.42.42.2(pid=10957): stdout: | (launched: 2022-12-10_12:57:45.875090) 12:57:49.583594 run osmo-hlr_10.42.42.2(pid=10957): stderr: | [0;m[1;31m20221210125746163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125746163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125746163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125746163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125746163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125746163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125746181 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125746205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125746205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125746205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:49.635580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10956): Terminating (SIGTERM) 12:57:49.677815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10959): Terminating (SIGTERM) 12:57:49.719852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10962): Terminating (SIGTERM) 12:57:49.762148 --- ParallelTerminationStrategy: PID 10956 died... 12:57:49.782052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10956): Terminated: ok {rc=0} 12:57:49.828374 --- ParallelTerminationStrategy: PID 10959 died... 12:57:49.847917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10959): Terminated: ok {rc=0} 12:57:49.893854 --- ParallelTerminationStrategy: PID 10962 died... 12:57:49.913247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10962): Terminated: ok {rc=0} 12:57:49.999353 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:57:51.291600 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:57:51.298352 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:57:51.319099 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:57:51.358434 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:57:51.447415 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:57:51.467511 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:57:51.505995 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:57:52.090852 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:57:52.140136 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:57:52.150797 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:57:52.205257 tst cs_paging_gprs_active.py: using LAC 28551 12:57:52.322076 tst cs_paging_gprs_active.py: using RAC 246 12:57:52.440071 tst cs_paging_gprs_active.py: using CellId 28551 12:57:52.556058 tst cs_paging_gprs_active.py: using BVCI 28552 12:57:52.665282 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:57:52.675861 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:57:52.686283 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:57:52.697505 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:57:52.708484 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:57:52.719582 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:57:52.730829 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:57:52.742036 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:57:52.753263 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:57:52.868319 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:57:52.982925 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:57:53.183890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:57:53.483360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10967): Launched 12:57:53.742536 run iperf3-srv_10.42.42.10(pid=10968): Launched 12:57:53.854514 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:57:54.054296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:57:54.353296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10969): Launched 12:57:54.612338 run iperf3-srv_10.42.42.10(pid=10970): Launched 12:57:54.724448 tst cs_paging_gprs_active.py:38: start network... 12:57:54.923931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:55.386333 run create_hlr_db(pid=10971): Launched 12:57:55.499465 bus /gobi_6: Setting Powered False 12:57:56.558369 run create_hlr_db(pid=10971): Terminated: ok {rc=0} 12:57:56.991305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10973): Launched 12:57:57.309290 run osmo-hlr_10.42.42.2(pid=10974): Launched 12:57:57.430855 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:57.979236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10976): Launched 12:57:58.295856 run osmo-stp_10.42.42.5(pid=10977): Launched 12:57:58.416607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:57:58.966371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10979): Launched 12:57:59.087261 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:57:59.356504 run patchelf(pid=10980): Launched 12:57:59.532600 run osmo-stp_10.42.42.5(pid=10977): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10977)] 12:57:59.666986 run osmo-stp_10.42.42.5(pid=10977): stdout: | (launched: 2022-12-10_12:57:58.238481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:59.803550 run osmo-stp_10.42.42.5(pid=10977): stderr: | [0;m[38;5;43m20221210125758431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125758432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125758432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125758432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125758433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125758433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125758433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:59.939846 run osmo-stp_10.42.42.5(pid=10977): stdout: | (launched: 2022-12-10_12:57:58.238481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:00.070472 run osmo-stp_10.42.42.5(pid=10977): stderr: | [0;m[38;5;43m20221210125758431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125758432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125758432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125758432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125758433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125758433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125758433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:00.224748 run patchelf(pid=10980): Terminating (SIGINT) 12:58:00.403019 run patchelf(pid=10980): Terminated: ok {rc=0} 12:58:00.531376 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10977): Process ended prematurely: osmo-stp_10.42.42.5(pid=10977) [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10977)] [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:58:00.541285 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 12:58:00.569290 run osmo-hlr_10.42.42.2(pid=10974): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10974)] 12:58:00.618769 run osmo-hlr_10.42.42.2(pid=10974): stdout: | (launched: 2022-12-10_12:57:57.251795) 12:58:00.669743 run osmo-hlr_10.42.42.2(pid=10974): stderr: | [0;m[1;31m20221210125757449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125757449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125757449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125757449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125757449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125757449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125757461 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125757469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125757469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125757469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:00.721503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10967): Terminating (SIGTERM) 12:58:00.762709 run iperf3-srv_10.42.42.10(pid=10968): Terminating (SIGTERM) 12:58:00.803961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10969): Terminating (SIGTERM) 12:58:00.847656 run iperf3-srv_10.42.42.10(pid=10970): Terminating (SIGTERM) 12:58:00.892919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10973): Terminating (SIGTERM) 12:58:00.939944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10976): Terminating (SIGTERM) 12:58:00.981726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10979): Terminating (SIGTERM) 12:58:01.023934 --- ParallelTerminationStrategy: PID 10967 died... 12:58:01.043662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10967): Terminated: ok {rc=0} 12:58:01.089970 --- ParallelTerminationStrategy: PID 10968 died... 12:58:01.109689 run iperf3-srv_10.42.42.10(pid=10968): Terminated {rc=256} 12:58:01.155603 --- ParallelTerminationStrategy: PID 10969 died... 12:58:01.175407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10969): Terminated: ok {rc=0} 12:58:01.221512 --- ParallelTerminationStrategy: PID 10970 died... 12:58:01.240820 run iperf3-srv_10.42.42.10(pid=10970): Terminated {rc=256} 12:58:01.287709 --- ParallelTerminationStrategy: PID 10973 died... 12:58:01.307475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10973): Terminated: ok {rc=0} 12:58:01.353727 --- ParallelTerminationStrategy: PID 10976 died... 12:58:01.373577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10976): Terminated: ok {rc=0} 12:58:01.419967 --- ParallelTerminationStrategy: PID 10979 died... 12:58:01.439926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10979): Terminated: ok {rc=0} 12:58:01.528045 bus /gobi_0: Setting Powered False 12:58:02.627090 bus /gobi_0: Setting Powered False 12:58:03.741087 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:58:04.885738 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:04.897077 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:58:04.954325 tst iperf3.py: using LAC 28552 12:58:05.073380 tst iperf3.py: using RAC 247 12:58:05.190730 tst iperf3.py: using CellId 28552 12:58:05.309559 tst iperf3.py: using BVCI 28553 12:58:05.426619 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:05.437954 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:05.448886 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:05.459923 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:05.470692 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:05.482071 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:05.494512 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:05.505346 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:05.516330 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:58:05.630510 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:58:05.830058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:58:06.128137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10981): Launched 12:58:06.386823 run iperf3-srv_10.42.42.10(pid=10982): Launched 12:58:06.498973 tst iperf3.py:8: start network... 12:58:06.699176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:07.161214 run create_hlr_db(pid=10983): Launched 12:58:07.275964 bus /gobi_6: Setting Powered False 12:58:08.335635 run create_hlr_db(pid=10983): Terminated: ok {rc=0} 12:58:08.769261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10985): Launched 12:58:09.086077 run osmo-hlr_10.42.42.2(pid=10986): Launched 12:58:09.207343 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:09.757316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10988): Launched 12:58:10.072753 run osmo-stp_10.42.42.5(pid=10989): Launched 12:58:10.194405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:58:10.743289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10992): Launched 12:58:10.863722 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:58:11.130531 run patchelf(pid=10993): Launched 12:58:11.306024 run osmo-stp_10.42.42.5(pid=10989): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10989)] 12:58:11.440195 run osmo-stp_10.42.42.5(pid=10989): stdout: | (launched: 2022-12-10_12:58:10.015464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:11.576025 run osmo-stp_10.42.42.5(pid=10989): stderr: | [0;m[38;5;43m20221210125810206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125810206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125810206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125810207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125810207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125810207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125810207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:11.712878 run osmo-stp_10.42.42.5(pid=10989): stdout: | (launched: 2022-12-10_12:58:10.015464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:11.843049 run osmo-stp_10.42.42.5(pid=10989): stderr: | [0;m[38;5;43m20221210125810206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125810206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125810206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125810207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125810207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125810207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125810207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:11.997754 run patchelf(pid=10993): Terminating (SIGINT) 12:58:12.175866 run patchelf(pid=10993): Terminated: ok {rc=0} 12:58:12.304182 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10989): Process ended prematurely: osmo-stp_10.42.42.5(pid=10989) [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10989)] [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 12:58:12.314252 tst iperf3.py:8: Test FAILED (7.5 sec) 12:58:12.342263 run osmo-hlr_10.42.42.2(pid=10986): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10986)] 12:58:12.391802 run osmo-hlr_10.42.42.2(pid=10986): stdout: | (launched: 2022-12-10_12:58:09.028795) 12:58:12.442920 run osmo-hlr_10.42.42.2(pid=10986): stderr: | [0;m[1;31m20221210125809226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125809226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125809226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125809226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125809226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125809226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125809238 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125809246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125809247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125809247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:12.495106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10981): Terminating (SIGTERM) 12:58:12.536325 run iperf3-srv_10.42.42.10(pid=10982): Terminating (SIGTERM) 12:58:12.577655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10985): Terminating (SIGTERM) 12:58:12.619037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10988): Terminating (SIGTERM) 12:58:12.660277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10992): Terminating (SIGTERM) 12:58:12.702104 --- ParallelTerminationStrategy: PID 10981 died... 12:58:12.721701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10981): Terminated: ok {rc=0} 12:58:12.767567 --- ParallelTerminationStrategy: PID 10982 died... 12:58:12.786986 run iperf3-srv_10.42.42.10(pid=10982): Terminated {rc=256} 12:58:12.832476 --- ParallelTerminationStrategy: PID 10985 died... 12:58:12.851753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10985): Terminated: ok {rc=0} 12:58:12.897112 --- ParallelTerminationStrategy: PID 10988 died... 12:58:12.916218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10988): Terminated: ok {rc=0} 12:58:12.962124 --- ParallelTerminationStrategy: PID 10992 died... 12:58:12.981425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10992): Terminated: ok {rc=0} 12:58:13.067651 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:58:14.216288 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:14.227972 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:58:14.289490 tst iperf3m4.py: using LAC 28553 12:58:14.413368 tst iperf3m4.py: using RAC 248 12:58:14.536037 tst iperf3m4.py: using CellId 28553 12:58:14.658904 tst iperf3m4.py: using BVCI 28554 12:58:14.774418 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:14.785590 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:14.796471 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:14.807383 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:14.818200 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:14.828917 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:14.839924 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:14.850750 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:14.861728 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:58:14.975909 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:58:15.092577 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:58:15.212623 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:58:15.327651 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:58:15.529613 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:58:15.841227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10994): Launched 12:58:16.175451 run iperf3-srv_10.42.42.10(pid=10995): Launched 12:58:16.306514 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:58:16.528203 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:58:16.869682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10996): Launched 12:58:17.177714 run iperf3-srv_10.42.42.10(pid=10998): Launched 12:58:17.298181 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:58:17.498973 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:58:17.799605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10999): Launched 12:58:18.059293 run iperf3-srv_10.42.42.10(pid=11000): Launched 12:58:18.171490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:58:18.371063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:58:18.670048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11001): Launched 12:58:18.928838 run iperf3-srv_10.42.42.10(pid=11002): Launched 12:58:19.040766 tst iperf3m4.py:8: start network... 12:58:19.241020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:19.703508 run create_hlr_db(pid=11003): Launched 12:58:19.818537 bus /gobi_6: Setting Powered False 12:58:20.878047 run create_hlr_db(pid=11003): Terminated: ok {rc=0} 12:58:21.292571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11005): Launched 12:58:21.590203 run osmo-hlr_10.42.42.2(pid=11006): Launched 12:58:21.704317 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:22.218213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11008): Launched 12:58:22.514739 run osmo-stp_10.42.42.5(pid=11009): Launched 12:58:22.628936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:58:23.145111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11011): Launched 12:58:23.259571 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:58:23.512328 run patchelf(pid=11012): Launched 12:58:23.678366 run osmo-stp_10.42.42.5(pid=11009): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11009)] 12:58:23.805526 run osmo-stp_10.42.42.5(pid=11009): stdout: | (launched: 2022-12-10_12:58:22.460523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:23.934504 run osmo-stp_10.42.42.5(pid=11009): stderr: | [0;m[38;5;43m20221210125822629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125822629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125822629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125822630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125822630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125822630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125822630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:24.063039 run osmo-stp_10.42.42.5(pid=11009): stdout: | (launched: 2022-12-10_12:58:22.460523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:24.186016 run osmo-stp_10.42.42.5(pid=11009): stderr: | [0;m[38;5;43m20221210125822629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125822629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125822629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125822630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125822630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125822630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125822630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:24.331688 run patchelf(pid=11012): Terminating (SIGINT) 12:58:24.500718 run patchelf(pid=11012): Terminated: ok {rc=0} 12:58:24.622639 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11009): Process ended prematurely: osmo-stp_10.42.42.5(pid=11009) [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11009)] [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:58:24.631821 tst iperf3m4.py:8: Test FAILED (10.5 sec) 12:58:24.659289 run osmo-hlr_10.42.42.2(pid=11006): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11006)] 12:58:24.706937 run osmo-hlr_10.42.42.2(pid=11006): stdout: | (launched: 2022-12-10_12:58:21.535880) 12:58:24.756037 run osmo-hlr_10.42.42.2(pid=11006): stderr: | [0;m[1;31m20221210125821711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125821711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125821711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125821711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125821711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125821711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125821723 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125821731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125821731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125821732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:24.805389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10994): Terminating (SIGTERM) 12:58:24.844580 run iperf3-srv_10.42.42.10(pid=10995): Terminating (SIGTERM) 12:58:24.883710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10996): Terminating (SIGTERM) 12:58:24.922889 run iperf3-srv_10.42.42.10(pid=10998): Terminating (SIGTERM) 12:58:24.962033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10999): Terminating (SIGTERM) 12:58:25.001414 run iperf3-srv_10.42.42.10(pid=11000): Terminating (SIGTERM) 12:58:25.040627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11001): Terminating (SIGTERM) 12:58:25.079839 run iperf3-srv_10.42.42.10(pid=11002): Terminating (SIGTERM) 12:58:25.119173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11005): Terminating (SIGTERM) 12:58:25.158309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11008): Terminating (SIGTERM) 12:58:25.197496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11011): Terminating (SIGTERM) 12:58:25.237087 --- ParallelTerminationStrategy: PID 10994 died... 12:58:25.255895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10994): Terminated: ok {rc=0} 12:58:25.299879 --- ParallelTerminationStrategy: PID 10995 died... 12:58:25.318191 run iperf3-srv_10.42.42.10(pid=10995): Terminated {rc=256} 12:58:25.361628 --- ParallelTerminationStrategy: PID 10996 died... 12:58:25.380200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10996): Terminated: ok {rc=0} 12:58:25.423881 --- ParallelTerminationStrategy: PID 10998 died... 12:58:25.442077 run iperf3-srv_10.42.42.10(pid=10998): Terminated {rc=256} 12:58:25.485898 --- ParallelTerminationStrategy: PID 10999 died... 12:58:25.504321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10999): Terminated: ok {rc=0} 12:58:25.547995 --- ParallelTerminationStrategy: PID 11000 died... 12:58:25.566210 run iperf3-srv_10.42.42.10(pid=11000): Terminated {rc=256} 12:58:25.609512 --- ParallelTerminationStrategy: PID 11001 died... 12:58:25.627808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11001): Terminated: ok {rc=0} 12:58:25.671453 --- ParallelTerminationStrategy: PID 11002 died... 12:58:25.689779 run iperf3-srv_10.42.42.10(pid=11002): Terminated {rc=256} 12:58:25.733405 --- ParallelTerminationStrategy: PID 11005 died... 12:58:25.751761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11005): Terminated: ok {rc=0} 12:58:25.795532 --- ParallelTerminationStrategy: PID 11008 died... 12:58:25.814437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11008): Terminated: ok {rc=0} 12:58:25.858155 --- ParallelTerminationStrategy: PID 11011 died... 12:58:25.876641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11011): Terminated: ok {rc=0} 12:58:25.959590 bus /gobi_4: Setting Powered False 12:58:27.056474 bus /gobi_4: Setting Powered False 12:58:28.174017 bus /gobi_1: Setting Powered False 12:58:29.270919 bus /gobi_1: Setting Powered False 12:58:30.386330 bus /gobi_0: Setting Powered False 12:58:31.500414 bus /gobi_0: Setting Powered False 12:58:32.626431 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:58:33.728542 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:33.739772 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:58:33.795264 tst ping.py: using LAC 28554 12:58:33.919578 tst ping.py: using RAC 249 12:58:34.042629 tst ping.py: using CellId 28554 12:58:34.169406 tst ping.py: using BVCI 28555 12:58:34.284674 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:34.295978 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:34.306949 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:34.317924 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:34.328721 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:34.339691 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:34.350828 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:34.361712 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:58:34.475716 tst ping.py:19: start network... 12:58:34.672099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:35.125171 run create_hlr_db(pid=11014): Launched 12:58:35.237396 bus /gobi_6: Setting Powered False 12:58:36.296408 run create_hlr_db(pid=11014): Terminated: ok {rc=0} 12:58:36.725101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11016): Launched 12:58:37.036398 run osmo-hlr_10.42.42.2(pid=11035): Launched 12:58:37.156327 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:37.696804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11038): Launched 12:58:38.007264 run osmo-stp_10.42.42.5(pid=11039): Launched 12:58:38.125500 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:58:38.664046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11041): Launched 12:58:38.784009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:58:39.048297 run patchelf(pid=11042): Launched 12:58:39.222587 run osmo-stp_10.42.42.5(pid=11039): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11039)] 12:58:39.355662 run osmo-stp_10.42.42.5(pid=11039): stdout: | (launched: 2022-12-10_12:58:37.950770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:39.490157 run osmo-stp_10.42.42.5(pid=11039): stderr: | [0;m[38;5;43m20221210125838139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125838139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125838139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125838140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125838140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125838140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125838140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:39.625401 run osmo-stp_10.42.42.5(pid=11039): stdout: | (launched: 2022-12-10_12:58:37.950770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:39.755163 run osmo-stp_10.42.42.5(pid=11039): stderr: | [0;m[38;5;43m20221210125838139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125838139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125838139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125838140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125838140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125838140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125838140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:39.907860 run patchelf(pid=11042): Terminating (SIGINT) 12:58:40.084323 run patchelf(pid=11042): Terminated: ok {rc=0} 12:58:40.211323 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11039): Process ended prematurely: osmo-stp_10.42.42.5(pid=11039) [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11039)] [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 12:58:40.220581 tst ping.py:22: Test FAILED (6.5 sec) 12:58:40.248336 run osmo-hlr_10.42.42.2(pid=11035): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11035)] 12:58:40.297982 run osmo-hlr_10.42.42.2(pid=11035): stdout: | (launched: 2022-12-10_12:58:36.979656) 12:58:40.349716 run osmo-hlr_10.42.42.2(pid=11035): stderr: | [0;m[1;31m20221210125837174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125837174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125837174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125837174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125837174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125837175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125837185 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125837194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125837194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125837194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:40.401781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11016): Terminating (SIGTERM) 12:58:40.443671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11038): Terminating (SIGTERM) 12:58:40.485722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11041): Terminating (SIGTERM) 12:58:40.527773 --- ParallelTerminationStrategy: PID 11016 died... 12:58:40.547747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11016): Terminated: ok {rc=0} 12:58:40.594189 --- ParallelTerminationStrategy: PID 11038 died... 12:58:40.613803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11038): Terminated: ok {rc=0} 12:58:40.659739 --- ParallelTerminationStrategy: PID 11041 died... 12:58:40.679309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11041): Terminated: ok {rc=0} 12:58:40.766371 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:58:41.853541 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:41.865236 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:58:41.923813 tst ping_idle_ping.py: using LAC 28555 12:58:42.041977 tst ping_idle_ping.py: using RAC 250 12:58:42.161379 tst ping_idle_ping.py: using CellId 28555 12:58:42.282756 tst ping_idle_ping.py: using BVCI 28556 12:58:42.392006 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:42.402788 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:42.413276 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:42.424372 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:42.435576 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:42.446753 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:42.458128 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:58:42.469425 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:58:42.589299 tst ping_idle_ping.py:24: start network... 12:58:42.800483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:43.285739 run create_hlr_db(pid=11043): Launched 12:58:43.413149 bus /gobi_6: Setting Powered False 12:58:44.475325 run create_hlr_db(pid=11043): Terminated: ok {rc=0} 12:58:44.911221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11046): Launched 12:58:45.223108 run osmo-hlr_10.42.42.2(pid=11047): Launched 12:58:45.342642 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:45.901629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11049): Launched 12:58:46.242857 run osmo-stp_10.42.42.5(pid=11050): Launched 12:58:46.542653 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:58:47.307217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11052): Launched 12:58:47.434703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:58:47.698792 run patchelf(pid=11053): Launched 12:58:47.874141 run osmo-stp_10.42.42.5(pid=11050): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11050)] 12:58:48.006958 run osmo-stp_10.42.42.5(pid=11050): stdout: | (launched: 2022-12-10_12:58:46.172646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:48.141578 run osmo-stp_10.42.42.5(pid=11050): stderr: | [0;m[38;5;43m20221210125846485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125846485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125846486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125846488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125846490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125846490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125846490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:48.276327 run osmo-stp_10.42.42.5(pid=11050): stdout: | (launched: 2022-12-10_12:58:46.172646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:48.405290 run osmo-stp_10.42.42.5(pid=11050): stderr: | [0;m[38;5;43m20221210125846485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125846485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125846486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125846488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125846490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125846490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125846490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:48.557865 run patchelf(pid=11053): Terminating (SIGINT) 12:58:48.735415 run patchelf(pid=11053): Terminated: ok {rc=0} 12:58:48.862621 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11050): Process ended prematurely: osmo-stp_10.42.42.5(pid=11050) [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11050)] [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:58:48.872057 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 12:58:48.899838 run osmo-hlr_10.42.42.2(pid=11047): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11047)] 12:58:48.950017 run osmo-hlr_10.42.42.2(pid=11047): stdout: | (launched: 2022-12-10_12:58:45.166362) 12:58:49.001878 run osmo-hlr_10.42.42.2(pid=11047): stderr: | [0;m[1;31m20221210125845361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125845361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125845362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125845362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125845362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125845362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125845374 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125845382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125845383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125845383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:49.054126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11046): Terminating (SIGTERM) 12:58:49.096057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11049): Terminating (SIGTERM) 12:58:49.138083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11052): Terminating (SIGTERM) 12:58:49.180418 --- ParallelTerminationStrategy: PID 11046 died... 12:58:49.200300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11046): Terminated: ok {rc=0} 12:58:49.246748 --- ParallelTerminationStrategy: PID 11049 died... 12:58:49.266321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11049): Terminated: ok {rc=0} 12:58:49.312654 --- ParallelTerminationStrategy: PID 11052 died... 12:58:49.332314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11052): Terminated: ok {rc=0} 12:58:49.420416 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:58:50.709827 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:58:50.716102 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:58:50.737073 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:58:50.776103 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:58:50.862967 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:58:50.883580 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:58:50.921979 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:58:51.515285 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:58:51.566481 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:58:51.577586 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:58:51.634541 tst cs_paging_gprs_active.py: using LAC 28556 12:58:51.759827 tst cs_paging_gprs_active.py: using RAC 251 12:58:51.884469 tst cs_paging_gprs_active.py: using CellId 28556 12:58:52.008802 tst cs_paging_gprs_active.py: using BVCI 28557 12:58:52.124160 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:58:52.135276 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:58:52.146170 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:58:52.156994 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:58:52.167654 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:58:52.178511 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:58:52.189996 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:58:52.200774 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:58:52.211765 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:58:52.330809 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:58:52.450215 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:58:52.664311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:58:52.983110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11057): Launched 12:58:53.259879 run iperf3-srv_10.42.42.10(pid=11058): Launched 12:58:53.379715 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:58:53.594263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:58:53.914043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11059): Launched 12:58:54.189484 run iperf3-srv_10.42.42.10(pid=11060): Launched 12:58:54.308427 tst cs_paging_gprs_active.py:38: start network... 12:58:54.522774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:55.018944 run create_hlr_db(pid=11061): Launched 12:58:55.147655 bus /gobi_6: Setting Powered False 12:58:56.210671 run create_hlr_db(pid=11061): Terminated: ok {rc=0} 12:58:56.637031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11063): Launched 12:58:56.935979 run osmo-hlr_10.42.42.2(pid=11064): Launched 12:58:57.059054 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:57.609745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11066): Launched 12:58:57.928489 run osmo-stp_10.42.42.5(pid=11067): Launched 12:58:58.050415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:58:58.601813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11069): Launched 12:58:58.723553 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:58:58.993188 run patchelf(pid=11070): Launched 12:58:59.169674 run osmo-stp_10.42.42.5(pid=11067): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11067)] 12:58:59.304544 run osmo-stp_10.42.42.5(pid=11067): stdout: | (launched: 2022-12-10_12:58:57.870888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:59.441452 run osmo-stp_10.42.42.5(pid=11067): stderr: | [0;m[38;5;43m20221210125858064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125858064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125858064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125858064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125858065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125858065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125858065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:59.578089 run osmo-stp_10.42.42.5(pid=11067): stdout: | (launched: 2022-12-10_12:58:57.870888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:59.709507 run osmo-stp_10.42.42.5(pid=11067): stderr: | [0;m[38;5;43m20221210125858064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125858064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125858064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125858064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125858065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125858065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125858065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:59.865265 run patchelf(pid=11070): Terminating (SIGINT) 12:59:00.043460 run patchelf(pid=11070): Terminated: ok {rc=0} 12:59:00.171959 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11067): Process ended prematurely: osmo-stp_10.42.42.5(pid=11067) [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11067)] [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:59:00.181999 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:59:00.209953 run osmo-hlr_10.42.42.2(pid=11064): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11064)] 12:59:00.259494 run osmo-hlr_10.42.42.2(pid=11064): stdout: | (launched: 2022-12-10_12:58:56.881633) 12:59:00.310680 run osmo-hlr_10.42.42.2(pid=11064): stderr: | [0;m[1;31m20221210125857076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125857076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125857076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125857076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125857076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125857076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125857089 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125857097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125857097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125857097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:00.362466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11057): Terminating (SIGTERM) 12:59:00.403596 run iperf3-srv_10.42.42.10(pid=11058): Terminating (SIGTERM) 12:59:00.444640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11059): Terminating (SIGTERM) 12:59:00.486106 run iperf3-srv_10.42.42.10(pid=11060): Terminating (SIGTERM) 12:59:00.527391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11063): Terminating (SIGTERM) 12:59:00.568547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11066): Terminating (SIGTERM) 12:59:00.609603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11069): Terminating (SIGTERM) 12:59:00.650709 --- ParallelTerminationStrategy: PID 11057 died... 12:59:00.670300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11057): Terminated: ok {rc=0} 12:59:00.715685 --- ParallelTerminationStrategy: PID 11058 died... 12:59:00.734675 run iperf3-srv_10.42.42.10(pid=11058): Terminated {rc=256} 12:59:00.779671 --- ParallelTerminationStrategy: PID 11059 died... 12:59:00.798718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11059): Terminated: ok {rc=0} 12:59:00.853928 --- ParallelTerminationStrategy: PID 11060 died... 12:59:00.878470 run iperf3-srv_10.42.42.10(pid=11060): Terminated {rc=256} 12:59:00.934402 --- ParallelTerminationStrategy: PID 11063 died... 12:59:00.953524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11063): Terminated: ok {rc=0} 12:59:01.002630 --- ParallelTerminationStrategy: PID 11066 died... 12:59:01.022587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11066): Terminated: ok {rc=0} 12:59:01.069341 --- ParallelTerminationStrategy: PID 11069 died... 12:59:01.088597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11069): Terminated: ok {rc=0} 12:59:01.175771 bus /gobi_0: Setting Powered False 12:59:02.271414 bus /gobi_0: Setting Powered False 12:59:03.384096 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:59:04.529569 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:04.541471 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:59:04.601188 tst iperf3.py: using LAC 28557 12:59:04.725636 tst iperf3.py: using RAC 252 12:59:04.851742 tst iperf3.py: using CellId 28557 12:59:04.979439 tst iperf3.py: using BVCI 28558 12:59:05.095443 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:05.106869 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:05.117778 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:05.128554 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:05.139335 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:05.150162 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:05.161217 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:05.171921 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:05.182895 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:59:05.297323 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:59:05.497761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:05.795007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11071): Launched 12:59:06.053023 run iperf3-srv_10.42.42.10(pid=11072): Launched 12:59:06.163949 tst iperf3.py:8: start network... 12:59:06.362260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:06.822840 run create_hlr_db(pid=11073): Launched 12:59:06.936081 bus /gobi_6: Setting Powered False 12:59:07.995818 run create_hlr_db(pid=11073): Terminated: ok {rc=0} 12:59:08.429288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11075): Launched 12:59:08.747116 run osmo-hlr_10.42.42.2(pid=11076): Launched 12:59:08.869205 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:09.417216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11078): Launched 12:59:09.733414 run osmo-stp_10.42.42.5(pid=11079): Launched 12:59:09.854996 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:59:10.402997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11081): Launched 12:59:10.523694 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:59:10.792102 run patchelf(pid=11082): Launched 12:59:10.968094 run osmo-stp_10.42.42.5(pid=11079): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11079)] 12:59:11.102395 run osmo-stp_10.42.42.5(pid=11079): stdout: | (launched: 2022-12-10_12:59:09.675683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:11.238829 run osmo-stp_10.42.42.5(pid=11079): stderr: | [0;m[38;5;43m20221210125909867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125909867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125909868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125909868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125909869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125909869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125909869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:11.375213 run osmo-stp_10.42.42.5(pid=11079): stdout: | (launched: 2022-12-10_12:59:09.675683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:11.505881 run osmo-stp_10.42.42.5(pid=11079): stderr: | [0;m[38;5;43m20221210125909867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125909867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125909868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125909868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125909869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125909869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125909869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:11.660795 run patchelf(pid=11082): Terminating (SIGINT) 12:59:11.840596 run patchelf(pid=11082): Terminated: ok {rc=0} 12:59:11.969567 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11079): Process ended prematurely: osmo-stp_10.42.42.5(pid=11079) [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11079)] [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 12:59:11.979571 tst iperf3.py:8: Test FAILED (7.5 sec) 12:59:12.007667 run osmo-hlr_10.42.42.2(pid=11076): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11076)] 12:59:12.058533 run osmo-hlr_10.42.42.2(pid=11076): stdout: | (launched: 2022-12-10_12:59:08.689618) 12:59:12.109928 run osmo-hlr_10.42.42.2(pid=11076): stderr: | [0;m[1;31m20221210125908886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125908886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125908886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125908886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125908886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125908886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125908899 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125908907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125908908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125908908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:12.161727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11071): Terminating (SIGTERM) 12:59:12.203052 run iperf3-srv_10.42.42.10(pid=11072): Terminating (SIGTERM) 12:59:12.244484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11075): Terminating (SIGTERM) 12:59:12.285902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11078): Terminating (SIGTERM) 12:59:12.327060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11081): Terminating (SIGTERM) 12:59:12.368674 --- ParallelTerminationStrategy: PID 11071 died... 12:59:12.388464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11071): Terminated: ok {rc=0} 12:59:12.434337 --- ParallelTerminationStrategy: PID 11072 died... 12:59:12.453723 run iperf3-srv_10.42.42.10(pid=11072): Terminated {rc=256} 12:59:12.499163 --- ParallelTerminationStrategy: PID 11075 died... 12:59:12.518512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11075): Terminated: ok {rc=0} 12:59:12.563856 --- ParallelTerminationStrategy: PID 11078 died... 12:59:12.583138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11078): Terminated: ok {rc=0} 12:59:12.628478 --- ParallelTerminationStrategy: PID 11081 died... 12:59:12.647829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11081): Terminated: ok {rc=0} 12:59:12.735163 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:59:13.883438 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:13.898759 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:59:13.954877 tst iperf3m4.py: using LAC 28558 12:59:14.079870 tst iperf3m4.py: using RAC 253 12:59:14.204670 tst iperf3m4.py: using CellId 28558 12:59:14.325612 tst iperf3m4.py: using BVCI 28559 12:59:14.443093 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:14.454545 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:14.465805 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:14.477017 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:14.487923 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:14.499109 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:14.510387 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:14.521339 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:14.532398 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:59:14.650158 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:59:14.768355 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:59:14.886084 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:59:15.000542 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:59:15.214461 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:15.531822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11083): Launched 12:59:15.808211 run iperf3-srv_10.42.42.10(pid=11084): Launched 12:59:15.944149 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:59:16.161866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:16.499318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11085): Launched 12:59:16.788492 run iperf3-srv_10.42.42.10(pid=11086): Launched 12:59:16.916264 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:59:17.133359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:17.452032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11087): Launched 12:59:17.727547 run iperf3-srv_10.42.42.10(pid=11088): Launched 12:59:17.846733 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:59:18.060854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:18.378577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11089): Launched 12:59:18.653797 run iperf3-srv_10.42.42.10(pid=11090): Launched 12:59:18.773419 tst iperf3m4.py:8: start network... 12:59:18.986716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:19.481138 run create_hlr_db(pid=11091): Launched 12:59:19.609928 bus /gobi_6: Setting Powered False 12:59:20.672296 run create_hlr_db(pid=11091): Terminated: ok {rc=0} 12:59:21.113676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11093): Launched 12:59:21.430559 run osmo-hlr_10.42.42.2(pid=11094): Launched 12:59:21.551493 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:22.100163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11096): Launched 12:59:22.417635 run osmo-stp_10.42.42.5(pid=11097): Launched 12:59:22.538477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:59:23.086612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11099): Launched 12:59:23.207477 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:59:23.475721 run patchelf(pid=11100): Launched 12:59:23.651479 run osmo-stp_10.42.42.5(pid=11097): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11097)] 12:59:23.786524 run osmo-stp_10.42.42.5(pid=11097): stdout: | (launched: 2022-12-10_12:59:22.360144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:23.923194 run osmo-stp_10.42.42.5(pid=11097): stderr: | [0;m[38;5;43m20221210125922551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125922552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125922552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125922552 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125922553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125922553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125922553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:24.059878 run osmo-stp_10.42.42.5(pid=11097): stdout: | (launched: 2022-12-10_12:59:22.360144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:24.190870 run osmo-stp_10.42.42.5(pid=11097): stderr: | [0;m[38;5;43m20221210125922551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125922552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125922552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125922552 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125922553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125922553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125922553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:24.345872 run patchelf(pid=11100): Terminating (SIGINT) 12:59:24.524059 run patchelf(pid=11100): Terminated: ok {rc=0} 12:59:24.652317 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11097): Process ended prematurely: osmo-stp_10.42.42.5(pid=11097) [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11097)] [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:59:24.662292 tst iperf3m4.py:8: Test FAILED (10.8 sec) 12:59:24.690702 run osmo-hlr_10.42.42.2(pid=11094): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11094)] 12:59:24.741176 run osmo-hlr_10.42.42.2(pid=11094): stdout: | (launched: 2022-12-10_12:59:21.373146) 12:59:24.792665 run osmo-hlr_10.42.42.2(pid=11094): stderr: | [0;m[1;31m20221210125921570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125921570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125921570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125921570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125921570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125921570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125921582 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125921591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125921591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125921591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:24.844530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11083): Terminating (SIGTERM) 12:59:24.886181 run iperf3-srv_10.42.42.10(pid=11084): Terminating (SIGTERM) 12:59:24.927792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11085): Terminating (SIGTERM) 12:59:24.969641 run iperf3-srv_10.42.42.10(pid=11086): Terminating (SIGTERM) 12:59:25.011208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11087): Terminating (SIGTERM) 12:59:25.052820 run iperf3-srv_10.42.42.10(pid=11088): Terminating (SIGTERM) 12:59:25.094260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11089): Terminating (SIGTERM) 12:59:25.135939 run iperf3-srv_10.42.42.10(pid=11090): Terminating (SIGTERM) 12:59:25.177376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11093): Terminating (SIGTERM) 12:59:25.218913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11096): Terminating (SIGTERM) 12:59:25.260536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11099): Terminating (SIGTERM) 12:59:25.302288 --- ParallelTerminationStrategy: PID 11083 died... 12:59:25.321942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11083): Terminated: ok {rc=0} 12:59:25.368518 --- ParallelTerminationStrategy: PID 11084 died... 12:59:25.387969 run iperf3-srv_10.42.42.10(pid=11084): Terminated {rc=256} 12:59:25.434150 --- ParallelTerminationStrategy: PID 11085 died... 12:59:25.453736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11085): Terminated: ok {rc=0} 12:59:25.499772 --- ParallelTerminationStrategy: PID 11086 died... 12:59:25.518991 run iperf3-srv_10.42.42.10(pid=11086): Terminated {rc=256} 12:59:25.564752 --- ParallelTerminationStrategy: PID 11087 died... 12:59:25.584139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11087): Terminated: ok {rc=0} 12:59:25.629693 --- ParallelTerminationStrategy: PID 11088 died... 12:59:25.648842 run iperf3-srv_10.42.42.10(pid=11088): Terminated {rc=256} 12:59:25.694537 --- ParallelTerminationStrategy: PID 11089 died... 12:59:25.714065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11089): Terminated: ok {rc=0} 12:59:25.760171 --- ParallelTerminationStrategy: PID 11090 died... 12:59:25.779755 run iperf3-srv_10.42.42.10(pid=11090): Terminated {rc=256} 12:59:25.825460 --- ParallelTerminationStrategy: PID 11093 died... 12:59:25.845046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11093): Terminated: ok {rc=0} 12:59:25.890845 --- ParallelTerminationStrategy: PID 11096 died... 12:59:25.910192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11096): Terminated: ok {rc=0} 12:59:25.956491 --- ParallelTerminationStrategy: PID 11099 died... 12:59:25.975972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11099): Terminated: ok {rc=0} 12:59:26.063361 bus /gobi_4: Setting Powered False 12:59:27.162933 bus /gobi_4: Setting Powered False 12:59:28.279568 bus /gobi_1: Setting Powered False 12:59:29.377748 bus /gobi_1: Setting Powered False 12:59:30.492336 bus /gobi_0: Setting Powered False 12:59:31.599416 bus /gobi_0: Setting Powered False 12:59:32.719500 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:59:33.821487 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:33.832648 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:59:33.889158 tst ping.py: using LAC 28559 12:59:34.009704 tst ping.py: using RAC 254 12:59:34.133569 tst ping.py: using CellId 28559 12:59:34.251034 tst ping.py: using BVCI 28560 12:59:34.358122 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:34.368903 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:34.379537 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:34.390520 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:34.401387 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:34.412158 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:34.422986 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:34.433650 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:59:34.546018 tst ping.py:19: start network... 12:59:34.741810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:35.193317 run create_hlr_db(pid=11101): Launched 12:59:35.304287 bus /gobi_6: Setting Powered False 12:59:36.363568 run create_hlr_db(pid=11101): Terminated: ok {rc=0} 12:59:36.772244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11103): Launched 12:59:37.064303 run osmo-hlr_10.42.42.2(pid=11104): Launched 12:59:37.176531 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:37.695418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11106): Launched 12:59:37.986696 run osmo-stp_10.42.42.5(pid=11107): Launched 12:59:38.097932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:59:38.602841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11109): Launched 12:59:38.714480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:59:38.961322 run patchelf(pid=11110): Launched 12:59:39.123947 run osmo-stp_10.42.42.5(pid=11107): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11107)] 12:59:39.247937 run osmo-stp_10.42.42.5(pid=11107): stdout: | (launched: 2022-12-10_12:59:37.933309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:39.373428 run osmo-stp_10.42.42.5(pid=11107): stderr: | [0;m[38;5;43m20221210125938104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125938104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125938104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125938105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125938105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125938105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125938105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:39.498866 run osmo-stp_10.42.42.5(pid=11107): stdout: | (launched: 2022-12-10_12:59:37.933309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:39.619334 run osmo-stp_10.42.42.5(pid=11107): stderr: | [0;m[38;5;43m20221210125938104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125938104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125938104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125938105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125938105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125938105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125938105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:39.762160 run patchelf(pid=11110): Terminating (SIGINT) 12:59:39.927080 run patchelf(pid=11110): Terminated: ok {rc=0} 12:59:40.046355 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11107): Process ended prematurely: osmo-stp_10.42.42.5(pid=11107) [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11107)] [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 12:59:40.055172 tst ping.py:22: Test FAILED (6.2 sec) 12:59:40.082412 run osmo-hlr_10.42.42.2(pid=11104): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11104)] 12:59:40.130226 run osmo-hlr_10.42.42.2(pid=11104): stdout: | (launched: 2022-12-10_12:59:37.010716) 12:59:40.179764 run osmo-hlr_10.42.42.2(pid=11104): stderr: | [0;m[1;31m20221210125937184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125937184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125937184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125937184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125937184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125937184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125937198 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125937206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125937206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125937206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:40.229843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11103): Terminating (SIGTERM) 12:59:40.269794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11106): Terminating (SIGTERM) 12:59:40.309305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11109): Terminating (SIGTERM) 12:59:40.349490 --- ParallelTerminationStrategy: PID 11103 died... 12:59:40.368429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11103): Terminated: ok {rc=0} 12:59:40.412775 --- ParallelTerminationStrategy: PID 11106 died... 12:59:40.431337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11106): Terminated: ok {rc=0} 12:59:40.475540 --- ParallelTerminationStrategy: PID 11109 died... 12:59:40.494186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11109): Terminated: ok {rc=0} 12:59:40.580189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:59:41.668780 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:41.680642 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:59:41.738015 tst ping_idle_ping.py: using LAC 28560 12:59:41.855834 tst ping_idle_ping.py: using RAC 255 12:59:41.971895 tst ping_idle_ping.py: using CellId 28560 12:59:42.087224 tst ping_idle_ping.py: using BVCI 28561 12:59:42.195934 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:42.206713 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:42.217305 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:42.228045 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:42.238662 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:42.249437 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:42.260205 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:59:42.270874 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:59:42.388512 tst ping_idle_ping.py:24: start network... 12:59:42.599766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:43.091301 run create_hlr_db(pid=11111): Launched 12:59:43.218516 bus /gobi_6: Setting Powered False 12:59:44.280742 run create_hlr_db(pid=11111): Terminated: ok {rc=0} 12:59:44.698783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11113): Launched 12:59:44.990509 run osmo-hlr_10.42.42.2(pid=11114): Launched 12:59:45.101913 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:45.618478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11116): Launched 12:59:45.939054 run osmo-stp_10.42.42.5(pid=11117): Launched 12:59:46.168104 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:59:46.785544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11119): Launched 12:59:46.911303 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:59:47.194924 run patchelf(pid=11120): Launched 12:59:47.372782 run osmo-stp_10.42.42.5(pid=11117): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11117)] 12:59:47.497627 run osmo-stp_10.42.42.5(pid=11117): stdout: | (launched: 2022-12-10_12:59:45.864212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:47.623835 run osmo-stp_10.42.42.5(pid=11117): stderr: | [0;m[38;5;43m20221210125946133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125946133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125946133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125946133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125946134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125946134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125946134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:47.749977 run osmo-stp_10.42.42.5(pid=11117): stdout: | (launched: 2022-12-10_12:59:45.864212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:47.871076 run osmo-stp_10.42.42.5(pid=11117): stderr: | [0;m[38;5;43m20221210125946133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125946133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125946133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125946133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125946134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125946134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125946134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:48.014342 run patchelf(pid=11120): Terminating (SIGINT) 12:59:48.180907 run patchelf(pid=11120): Terminated: ok {rc=0} 12:59:48.300362 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11117): Process ended prematurely: osmo-stp_10.42.42.5(pid=11117) [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11117)] [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:59:48.309214 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:59:48.335784 run osmo-hlr_10.42.42.2(pid=11114): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11114)] 12:59:48.383653 run osmo-hlr_10.42.42.2(pid=11114): stdout: | (launched: 2022-12-10_12:59:44.937258) 12:59:48.432891 run osmo-hlr_10.42.42.2(pid=11114): stderr: | [0;m[1;31m20221210125945114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125945114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125945114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125945114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125945114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125945114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125945126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125945134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125945134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125945134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:48.482589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11113): Terminating (SIGTERM) 12:59:48.521966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11116): Terminating (SIGTERM) 12:59:48.562229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11119): Terminating (SIGTERM) 12:59:48.602072 --- ParallelTerminationStrategy: PID 11113 died... 12:59:48.620812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11113): Terminated: ok {rc=0} 12:59:48.664679 --- ParallelTerminationStrategy: PID 11116 died... 12:59:48.683145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11116): Terminated: ok {rc=0} 12:59:48.726741 --- ParallelTerminationStrategy: PID 11119 died... 12:59:48.745085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11119): Terminated: ok {rc=0} 12:59:48.829268 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:59:50.111958 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:59:50.118262 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:59:50.139069 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:59:50.173192 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:59:50.225596 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:59:50.246431 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:59:50.281433 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:59:50.835469 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:59:50.840300 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:59:50.851300 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:59:50.906449 tst switch_tch_pdch.py: using LAC 28561 12:59:51.023252 tst switch_tch_pdch.py: using RAC 1 12:59:51.138308 tst switch_tch_pdch.py: using CellId 28561 12:59:51.255631 tst switch_tch_pdch.py: using BVCI 28562 12:59:51.362134 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:59:51.373099 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:59:51.383874 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:59:51.394843 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:59:51.405725 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:59:51.416559 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:59:51.427719 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:59:51.438623 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:59:51.555187 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:59:51.673327 tst switch_tch_pdch.py:51: start network... 12:59:51.882933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:52.364885 run create_hlr_db(pid=11124): Launched 12:59:52.491515 bus /gobi_6: Setting Powered False 12:59:53.552028 run create_hlr_db(pid=11124): Terminated: ok {rc=0} 12:59:53.985108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11126): Launched 12:59:54.295536 run osmo-hlr_10.42.42.2(pid=11127): Launched 12:59:54.414446 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:54.931999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11129): Launched 12:59:55.225541 run osmo-stp_10.42.42.5(pid=11130): Launched 12:59:55.337874 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:59:55.844370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11132): Launched 12:59:55.956528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:59:56.204557 run patchelf(pid=11133): Launched 12:59:56.367801 run osmo-stp_10.42.42.5(pid=11130): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11130)] 12:59:56.492299 run osmo-stp_10.42.42.5(pid=11130): stdout: | (launched: 2022-12-10_12:59:55.172367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:56.618251 run osmo-stp_10.42.42.5(pid=11130): stderr: | [0;m[38;5;43m20221210125955339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125955339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125955339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125955340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125955340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125955340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125955340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:56.744441 run osmo-stp_10.42.42.5(pid=11130): stdout: | (launched: 2022-12-10_12:59:55.172367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:56.865437 run osmo-stp_10.42.42.5(pid=11130): stderr: | [0;m[38;5;43m20221210125955339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210125955339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210125955339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210125955340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210125955340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210125955340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210125955340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:57.008571 run patchelf(pid=11133): Terminating (SIGINT) 12:59:57.174646 run patchelf(pid=11133): Terminated: ok {rc=0} 12:59:57.294085 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11130): Process ended prematurely: osmo-stp_10.42.42.5(pid=11130) [trial-2375↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11130)] [trial-2375↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:59:57.302755 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 12:59:57.329352 run osmo-hlr_10.42.42.2(pid=11127): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11127)] 12:59:57.377455 run osmo-hlr_10.42.42.2(pid=11127): stdout: | (launched: 2022-12-10_12:59:54.239196) 12:59:57.426841 run osmo-hlr_10.42.42.2(pid=11127): stderr: | [0;m[1;31m20221210125954434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210125954434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210125954434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210125954434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210125954434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210125954434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210125954451 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210125954461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210125954461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210125954462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:57.476370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11126): Terminating (SIGTERM) 12:59:57.516128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11129): Terminating (SIGTERM) 12:59:57.555948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11132): Terminating (SIGTERM) 12:59:57.595871 --- ParallelTerminationStrategy: PID 11126 died... 12:59:57.614661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11126): Terminated: ok {rc=0} 12:59:57.658494 --- ParallelTerminationStrategy: PID 11129 died... 12:59:57.676929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11129): Terminated: ok {rc=0} 12:59:57.720775 --- ParallelTerminationStrategy: PID 11132 died... 12:59:57.739125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11132): Terminated: ok {rc=0} 12:59:57.824899 bus /gobi_0: Setting Powered False 12:59:58.922730 bus /gobi_0: Setting Powered False 13:00:00.034721 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:00:01.302665 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:00:01.311353 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:00:01.334720 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:00:01.371804 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:00:01.425465 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:00:01.447556 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:00:01.484640 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:00:02.070182 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:00:02.076494 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:00:02.091207 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:00:02.159147 tst switch_tch_pdch.py: using LAC 28562 13:00:02.283085 tst switch_tch_pdch.py: using RAC 2 13:00:02.401900 tst switch_tch_pdch.py: using CellId 28562 13:00:02.517337 tst switch_tch_pdch.py: using BVCI 28563 13:00:02.625434 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:00:02.636221 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:00:02.647085 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:00:02.658168 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:00:02.669793 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:00:02.680319 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:00:02.691143 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:00:02.702026 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:00:02.819504 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:00:02.938351 tst switch_tch_pdch.py:51: start network... 13:00:03.149016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:03.606139 run create_hlr_db(pid=11141): Launched 13:00:03.733816 bus /gobi_6: Setting Powered False 13:00:04.795802 run create_hlr_db(pid=11141): Terminated: ok {rc=0} 13:00:05.202708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11143): Launched 13:00:05.513365 run osmo-hlr_10.42.42.2(pid=11144): Launched 13:00:05.631767 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:06.141029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11146): Launched 13:00:06.451848 run osmo-stp_10.42.42.5(pid=11147): Launched 13:00:06.570063 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:00:07.078616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11149): Launched 13:00:07.197157 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:00:07.459439 run patchelf(pid=11150): Launched 13:00:07.632034 run osmo-stp_10.42.42.5(pid=11147): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11147)] 13:00:07.764428 run osmo-stp_10.42.42.5(pid=11147): stdout: | (launched: 2022-12-10_13:00:06.395555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:07.898288 run osmo-stp_10.42.42.5(pid=11147): stderr: | [0;m[38;5;43m20221210130006587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130006587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130006588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130006588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130006589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130006589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130006589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:08.032085 run osmo-stp_10.42.42.5(pid=11147): stdout: | (launched: 2022-12-10_13:00:06.395555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:08.160715 run osmo-stp_10.42.42.5(pid=11147): stderr: | [0;m[38;5;43m20221210130006587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130006587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130006588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130006588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130006589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130006589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130006589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:08.313735 run patchelf(pid=11150): Terminating (SIGINT) 13:00:08.489382 run patchelf(pid=11150): Terminated: ok {rc=0} 13:00:08.615436 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11147): Process ended prematurely: osmo-stp_10.42.42.5(pid=11147) [trial-2375↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11147)] [trial-2375↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:00:08.624935 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 13:00:08.652624 run osmo-hlr_10.42.42.2(pid=11144): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11144)] 13:00:08.701803 run osmo-hlr_10.42.42.2(pid=11144): stdout: | (launched: 2022-12-10_13:00:05.457083) 13:00:08.753193 run osmo-hlr_10.42.42.2(pid=11144): stderr: | [0;m[1;31m20221210130005655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130005655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130005655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130005655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130005655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130005655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130005667 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130005675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130005675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130005675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:08.804697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11143): Terminating (SIGTERM) 13:00:08.846192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11146): Terminating (SIGTERM) 13:00:08.887532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11149): Terminating (SIGTERM) 13:00:08.929351 --- ParallelTerminationStrategy: PID 11143 died... 13:00:08.948762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11143): Terminated: ok {rc=0} 13:00:08.994818 --- ParallelTerminationStrategy: PID 11146 died... 13:00:09.014252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11146): Terminated: ok {rc=0} 13:00:09.060363 --- ParallelTerminationStrategy: PID 11149 died... 13:00:09.079865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11149): Terminated: ok {rc=0} 13:00:09.166418 bus /gobi_0: Setting Powered False 13:00:10.264273 bus /gobi_0: Setting Powered False 13:00:11.379161 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_sms:trx-b200 --------------------------------------------------------------------- 13:00:12.611398 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:00:12.615430 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 13:00:12.648653 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 13:00:12.655499 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 13:00:12.706944 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 13:00:12.740545 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 13:00:12.747343 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 13:00:13.286985 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 13:00:13.292041 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 13:00:13.302912 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 13:00:13.351223 tst mo_mt_sms.py: using LAC 28563 13:00:13.474410 tst mo_mt_sms.py: using RAC 3 13:00:13.596609 tst mo_mt_sms.py: using CellId 28563 13:00:13.718077 tst mo_mt_sms.py: using BVCI 28564 13:00:13.832330 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 13:00:13.949294 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 13:00:14.061508 tst mo_mt_sms.py:9: start nitb and bts... 13:00:14.257257 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:00:14.856276 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11154): Launched 13:00:15.148636 run osmo-nitb_10.42.42.2(pid=11155): Launched 13:00:15.310553 run osmo-nitb_10.42.42.2(pid=11155): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11155)] 13:00:15.442448 run osmo-nitb_10.42.42.2(pid=11155): stdout: | (launched: 2022-12-10_13:00:15.095123) 13:00:15.575514 run osmo-nitb_10.42.42.2(pid=11155): stderr: | (launched: 2022-12-10_13:00:15.138889) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:00:15.708623 run osmo-nitb_10.42.42.2(pid=11155): stdout: | (launched: 2022-12-10_13:00:15.095123) 13:00:15.837163 run osmo-nitb_10.42.42.2(pid=11155): stderr: | (launched: 2022-12-10_13:00:15.138889) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11155): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11155) [trial-2375↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11155)] 13:00:16.258376 tst osmo-nitb_10.42.42.2(pid=11155): stdout: | (launched: 2022-12-10_13:00:15.095123) 13:00:16.377880 tst osmo-nitb_10.42.42.2(pid=11155): stderr: | (launched: 2022-12-10_13:00:15.138889) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:00:16.519945 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=11155): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11155) [trial-2375↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11155)] [trial-2375↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 13:00:16.529264 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 13:00:16.536789 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11154): Terminating (SIGTERM) 13:00:16.748742 --- ParallelTerminationStrategy: PID 11154 died... 13:00:16.768624 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11154): Terminated: ok {rc=0} 13:00:16.860505 bus /sierra_3: Setting Powered False 13:00:17.958999 bus /sierra_3: Setting Powered False 13:00:19.076185 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 sms:trx-b200 --------------------------------------------------------------------- 13:00:20.269794 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:00:20.273805 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 13:00:20.306545 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 13:00:20.332535 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 13:00:20.383038 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 13:00:20.415424 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 13:00:20.441378 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 13:00:20.987247 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 13:00:20.992269 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:00:21.002806 tst sms:trx-b200: Using 1 x bts (candidates: 1) 13:00:21.049189 tst mo_mt_sms.py: using LAC 28564 13:00:21.166052 tst mo_mt_sms.py: using RAC 4 13:00:21.283778 tst mo_mt_sms.py: using CellId 28564 13:00:21.402832 tst mo_mt_sms.py: using BVCI 28565 13:00:21.510018 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:00:21.520276 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:00:21.530530 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:00:21.540891 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:00:21.551310 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:00:21.561960 tst sms:trx-b200: Using 1 x modem (candidates: 2) 13:00:21.678748 tst sms:trx-b200: Using 1 x modem (candidates: 2) 13:00:21.793303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:22.246779 run create_hlr_db(pid=11159): Launched 13:00:22.357981 bus /sierra_2: Setting Powered False 13:00:23.416857 run create_hlr_db(pid=11159): Terminated: ok {rc=0} 13:00:23.824520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11161): Launched 13:00:24.116141 run osmo-hlr_10.42.42.2(pid=11162): Launched 13:00:24.227549 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:24.729939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11164): Launched 13:00:25.021321 run osmo-stp_10.42.42.5(pid=11165): Launched 13:00:25.133154 run osmo-msc_10.42.42.6: Starting osmo-msc 13:00:25.661472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11167): Launched 13:00:25.953452 run osmo-msc_10.42.42.6(pid=11168): Launched 13:00:26.117416 run osmo-stp_10.42.42.5(pid=11165): ERR: Terminated: ERROR {rc=1} [trial-2375↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11165)] 13:00:26.242569 run osmo-stp_10.42.42.5(pid=11165): stdout: | (launched: 2022-12-10_13:00:24.968412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:26.367928 run osmo-stp_10.42.42.5(pid=11165): stderr: | [0;m[38;5;43m20221210130025138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130025138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130025138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130025139 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130025139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130025139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130025139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:26.491597 run osmo-stp_10.42.42.5(pid=11165): stdout: | (launched: 2022-12-10_13:00:24.968412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:26.607969 run osmo-stp_10.42.42.5(pid=11165): stderr: | [0;m[38;5;43m20221210130025138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130025138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130025138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130025139 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130025139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130025139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130025139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:26.747468 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=11165): Process ended prematurely: osmo-stp_10.42.42.5(pid=11165) [trial-2375↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11165)] [trial-2375↪sms:trx-b200↪mo_mt_sms.py:16] 13:00:26.756022 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 13:00:26.782192 run osmo-hlr_10.42.42.2(pid=11162): ERR: Terminated: ERROR {rc=237} [trial-2375↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11162)] 13:00:26.829800 run osmo-hlr_10.42.42.2(pid=11162): stdout: | (launched: 2022-12-10_13:00:24.063313) 13:00:26.878651 run osmo-hlr_10.42.42.2(pid=11162): stderr: | [0;m[1;31m20221210130024239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130024239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130024239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130024239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130024239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130024239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130024251 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130024259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130024260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130024260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:26.947002 run osmo-msc_10.42.42.6(pid=11168): ERR: Terminated: ERROR {rc=2} [trial-2375↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11168)] 13:00:26.994414 run osmo-msc_10.42.42.6(pid=11168): stdout: | (launched: 2022-12-10_13:00:25.900071) 13:00:27.043171 run osmo-msc_10.42.42.6(pid=11168): stderr: | [0;m[38;5;43m20221210130026171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130026171 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2650878c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130026171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130026171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130026172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130026172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130026174 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130026174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130026174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130026174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:00:27.092402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11161): Terminating (SIGTERM) 13:00:27.131895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11164): Terminating (SIGTERM) 13:00:27.171288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11167): Terminating (SIGTERM) 13:00:27.210953 --- ParallelTerminationStrategy: PID 11161 died... 13:00:27.229978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11161): Terminated: ok {rc=0} 13:00:27.274082 --- ParallelTerminationStrategy: PID 11164 died... 13:00:27.292509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11164): Terminated: ok {rc=0} 13:00:27.336804 --- ParallelTerminationStrategy: PID 11167 died... 13:00:27.355663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11167): Terminated: ok {rc=0} 13:00:27.441034 bus /sierra_3: Setting Powered False 13:00:28.538753 bus /sierra_3: Setting Powered False 13:00:29.650584 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_ussd:trx-b200 --------------------------------------------------------------------- 13:00:30.883826 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:00:30.888642 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 13:00:30.924803 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 13:00:30.932694 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 13:00:30.969577 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 13:00:31.028547 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 13:00:31.037327 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 13:00:31.535092 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2375 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 13:00:31.541994 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 13:00:31.556663 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 13:00:31.617435 tst assert_extension.py: using LAC 28565 13:00:31.733245 tst assert_extension.py: using RAC 5 13:00:31.853375 tst assert_extension.py: using CellId 28565 13:00:31.969235 tst assert_extension.py: using BVCI 28566 13:00:32.079768 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 13:00:32.219152 tst assert_extension.py:10: start nitb and bts... 13:00:32.439707 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:00:33.037530 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11173): Launched 13:00:33.329513 run osmo-nitb_10.42.42.2(pid=11174): Launched 13:00:33.492115 run osmo-nitb_10.42.42.2(pid=11174): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11174)] 13:00:33.623593 run osmo-nitb_10.42.42.2(pid=11174): stdout: | (launched: 2022-12-10_13:00:33.275937) 13:00:33.756282 run osmo-nitb_10.42.42.2(pid=11174): stderr: | (launched: 2022-12-10_13:00:33.319725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:00:33.889365 run osmo-nitb_10.42.42.2(pid=11174): stdout: | (launched: 2022-12-10_13:00:33.275937) 13:00:34.016882 run osmo-nitb_10.42.42.2(pid=11174): stderr: | (launched: 2022-12-10_13:00:33.319725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11174): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11174) [trial-2375↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11174)] 13:00:34.440433 tst osmo-nitb_10.42.42.2(pid=11174): stdout: | (launched: 2022-12-10_13:00:33.275937) 13:00:34.558282 tst osmo-nitb_10.42.42.2(pid=11174): stderr: | (launched: 2022-12-10_13:00:33.319725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:00:34.696681 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=11174): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11174) [trial-2375↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11174)] [trial-2375↪nitb_ussd:trx-b200↪assert_extension.py:12] 13:00:34.705212 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:00:34.711827 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11173): Terminating (SIGTERM) 13:00:34.920513 --- ParallelTerminationStrategy: PID 11173 died... 13:00:34.940844 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11173): Terminated: ok {rc=0} 13:00:35.025834 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 ussd:trx-b200 --------------------------------------------------------------------- 13:00:36.200278 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:00:36.204090 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 13:00:36.237118 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 13:00:36.262889 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 13:00:36.298537 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 13:00:36.332720 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 13:00:36.360524 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 13:00:36.882704 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2375 ussd:trx-b200 assert_extension.py ---------------------------------------------- 13:00:36.888198 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:00:36.899007 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 13:00:36.959149 tst assert_extension.py: using LAC 28566 13:00:37.084017 tst assert_extension.py: using RAC 6 13:00:37.207786 tst assert_extension.py: using CellId 28566 13:00:37.328230 tst assert_extension.py: using BVCI 28567 13:00:37.442911 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:00:37.453968 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:00:37.464754 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:00:37.475422 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:00:37.486328 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:00:37.496886 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 13:00:37.610140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:38.062304 run create_hlr_db(pid=11178): Launched 13:00:38.174416 bus /sierra_2: Setting Powered False 13:00:39.232861 run create_hlr_db(pid=11178): Terminated: ok {rc=0} 13:00:39.658985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11180): Launched 13:00:39.970385 run osmo-hlr_10.42.42.2(pid=11181): Launched 13:00:40.088847 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:40.631632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11183): Launched 13:00:40.943676 run osmo-stp_10.42.42.5(pid=11184): Launched 13:00:41.062402 run osmo-msc_10.42.42.6: Starting osmo-msc 13:00:41.623356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11186): Launched 13:00:41.933984 run osmo-msc_10.42.42.6(pid=11187): Launched 13:00:42.107092 run osmo-stp_10.42.42.5(pid=11184): ERR: Terminated: ERROR {rc=1} [trial-2375↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11184)] 13:00:42.238687 run osmo-stp_10.42.42.5(pid=11184): stdout: | (launched: 2022-12-10_13:00:40.887117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:42.370460 run osmo-stp_10.42.42.5(pid=11184): stderr: | [0;m[38;5;43m20221210130041081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130041081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130041081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130041082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130041082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130041082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130041082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:42.501802 run osmo-stp_10.42.42.5(pid=11184): stdout: | (launched: 2022-12-10_13:00:40.887117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:42.626097 run osmo-stp_10.42.42.5(pid=11184): stderr: | [0;m[38;5;43m20221210130041081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130041081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130041081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130041082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130041082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130041082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130041082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:42.774687 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=11184): Process ended prematurely: osmo-stp_10.42.42.5(pid=11184) [trial-2375↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11184)] [trial-2375↪ussd:trx-b200↪assert_extension.py:17] 13:00:42.783755 tst assert_extension.py:17: Test FAILED (5.9 sec) 13:00:42.810873 run osmo-hlr_10.42.42.2(pid=11181): ERR: Terminated: ERROR {rc=237} [trial-2375↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11181)] 13:00:42.860698 run osmo-hlr_10.42.42.2(pid=11181): stdout: | (launched: 2022-12-10_13:00:39.914113) 13:00:42.912075 run osmo-hlr_10.42.42.2(pid=11181): stderr: | [0;m[1;31m20221210130040112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130040112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130040112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130040112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130040112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130040112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130040123 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130040131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130040132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130040132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:42.983712 run osmo-msc_10.42.42.6(pid=11187): ERR: Terminated: ERROR {rc=2} [trial-2375↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11187)] 13:00:43.033401 run osmo-msc_10.42.42.6(pid=11187): stdout: | (launched: 2022-12-10_13:00:41.877403) 13:00:43.084477 run osmo-msc_10.42.42.6(pid=11187): stderr: | [0;m[38;5;43m20221210130042197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130042197 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3a1398cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130042197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130042197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130042197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130042198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130042199 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130042200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130042200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130042200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:00:43.136076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11180): Terminating (SIGTERM) 13:00:43.177270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11183): Terminating (SIGTERM) 13:00:43.218664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11186): Terminating (SIGTERM) 13:00:43.260505 --- ParallelTerminationStrategy: PID 11180 died... 13:00:43.280462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11180): Terminated: ok {rc=0} 13:00:43.326666 --- ParallelTerminationStrategy: PID 11183 died... 13:00:43.346089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11183): Terminated: ok {rc=0} 13:00:43.391798 --- ParallelTerminationStrategy: PID 11186 died... 13:00:43.411339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11186): Terminated: ok {rc=0} 13:00:43.498321 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:00:44.711020 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:00:44.717504 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:00:44.750406 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:00:44.776488 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:00:44.825238 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:00:44.857413 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:00:44.883297 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:00:45.436132 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:00:45.485204 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:00:45.495926 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:00:45.561528 tst mo_mt_call.py: using LAC 28567 13:00:45.686942 tst mo_mt_call.py: using RAC 7 13:00:45.810849 tst mo_mt_call.py: using CellId 28567 13:00:45.961098 tst mo_mt_call.py: using BVCI 28568 13:00:46.076670 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:00:46.088507 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:00:46.100458 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:00:46.113507 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:00:46.127506 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:00:46.139216 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:00:46.264224 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:00:46.386106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:46.871867 run create_hlr_db(pid=11193): Launched 13:00:47.026989 bus /sierra_2: Setting Powered False 13:00:48.086266 run create_hlr_db(pid=11193): Terminated: ok {rc=0} 13:00:48.500617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11195): Launched 13:00:48.797452 run osmo-hlr_10.42.42.2(pid=11196): Launched 13:00:48.911513 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:49.441398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11198): Launched 13:00:49.739869 run osmo-stp_10.42.42.5(pid=11199): Launched 13:00:49.853446 run osmo-msc_10.42.42.6: Starting osmo-msc 13:00:50.392617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11201): Launched 13:00:50.690275 run osmo-msc_10.42.42.6(pid=11202): Launched 13:00:50.857327 run osmo-stp_10.42.42.5(pid=11199): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11199)] 13:00:50.983722 run osmo-stp_10.42.42.5(pid=11199): stdout: | (launched: 2022-12-10_13:00:49.685572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:51.110214 run osmo-stp_10.42.42.5(pid=11199): stderr: | [0;m[38;5;43m20221210130049856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130049856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130049856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130049856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130049859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130049859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130049859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:51.234432 run osmo-stp_10.42.42.5(pid=11199): stdout: | (launched: 2022-12-10_13:00:49.685572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:51.352930 run osmo-stp_10.42.42.5(pid=11199): stderr: | [0;m[38;5;43m20221210130049856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130049856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130049856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130049856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130049859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130049859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130049859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:51.494602 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11199): Process ended prematurely: osmo-stp_10.42.42.5(pid=11199) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11199)] [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:00:51.503316 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:00:51.529604 run osmo-hlr_10.42.42.2(pid=11196): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11196)] 13:00:51.577305 run osmo-hlr_10.42.42.2(pid=11196): stdout: | (launched: 2022-12-10_13:00:48.743601) 13:00:51.626316 run osmo-hlr_10.42.42.2(pid=11196): stderr: | [0;m[1;31m20221210130048921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130048921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130048921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130048921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130048921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130048921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130048938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130048948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130048948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130048948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:51.694249 run osmo-msc_10.42.42.6(pid=11202): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11202)] 13:00:51.741411 run osmo-msc_10.42.42.6(pid=11202): stdout: | (launched: 2022-12-10_13:00:50.636299) 13:00:51.790212 run osmo-msc_10.42.42.6(pid=11202): stderr: | [0;m[38;5;43m20221210130050906 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130050906 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8fc70acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130050906 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130050906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130050907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130050907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130050911 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130050911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130050912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130050912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:00:51.839797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11195): Terminating (SIGTERM) 13:00:51.878799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11198): Terminating (SIGTERM) 13:00:51.917916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11201): Terminating (SIGTERM) 13:00:51.957152 --- ParallelTerminationStrategy: PID 11195 died... 13:00:51.975630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11195): Terminated: ok {rc=0} 13:00:52.018868 --- ParallelTerminationStrategy: PID 11198 died... 13:00:52.036894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11198): Terminated: ok {rc=0} 13:00:52.080886 --- ParallelTerminationStrategy: PID 11201 died... 13:00:52.099494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11201): Terminated: ok {rc=0} 13:00:52.184444 bus /sierra_3: Setting Powered False 13:00:53.283619 bus /sierra_3: Setting Powered False 13:00:54.400457 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:00:55.549039 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:00:55.560898 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:00:55.631989 tst mo_mt_call_osmux.py: using LAC 28568 13:00:55.758573 tst mo_mt_call_osmux.py: using RAC 8 13:00:55.885676 tst mo_mt_call_osmux.py: using CellId 28568 13:00:56.010479 tst mo_mt_call_osmux.py: using BVCI 28569 13:00:56.128050 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:00:56.139465 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:00:56.150591 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:00:56.161740 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:00:56.172834 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:00:56.184051 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:00:56.302582 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:00:56.421663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:56.913505 run create_hlr_db(pid=11204): Launched 13:00:57.042738 bus /sierra_2: Setting Powered False 13:00:58.101897 run create_hlr_db(pid=11204): Terminated: ok {rc=0} 13:00:58.522024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11206): Launched 13:00:58.820362 run osmo-hlr_10.42.42.2(pid=11207): Launched 13:00:58.933935 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:59.445423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11209): Launched 13:00:59.744325 run osmo-stp_10.42.42.5(pid=11210): Launched 13:00:59.857859 run osmo-msc_10.42.42.6: Starting osmo-msc 13:01:00.396009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11212): Launched 13:01:00.692319 run osmo-msc_10.42.42.6(pid=11213): Launched 13:01:00.891069 run osmo-stp_10.42.42.5(pid=11210): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11210)] 13:01:01.094098 run osmo-stp_10.42.42.5(pid=11210): stdout: | (launched: 2022-12-10_13:00:59.689843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:01.281842 run osmo-stp_10.42.42.5(pid=11210): stderr: | [0;m[38;5;43m20221210130059860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130059861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130059861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130059861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130059863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130059863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130059864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:01.451868 run osmo-stp_10.42.42.5(pid=11210): stdout: | (launched: 2022-12-10_13:00:59.689843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:01.582372 run osmo-stp_10.42.42.5(pid=11210): stderr: | [0;m[38;5;43m20221210130059860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130059861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130059861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130059861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130059863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130059863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130059864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:01.739473 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11210): Process ended prematurely: osmo-stp_10.42.42.5(pid=11210) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11210)] [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:01:01.749524 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:01:01.778990 run osmo-hlr_10.42.42.2(pid=11207): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11207)] 13:01:01.831800 run osmo-hlr_10.42.42.2(pid=11207): stdout: | (launched: 2022-12-10_13:00:58.766034) 13:01:01.885816 run osmo-hlr_10.42.42.2(pid=11207): stderr: | [0;m[1;31m20221210130058940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130058940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130058940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130058940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130058940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130058940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130058953 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130058962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130058962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130058962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:01.961939 run osmo-msc_10.42.42.6(pid=11213): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11213)] 13:01:02.014415 run osmo-msc_10.42.42.6(pid=11213): stdout: | (launched: 2022-12-10_13:01:00.638166) 13:01:02.068777 run osmo-msc_10.42.42.6(pid=11213): stderr: | [0;m[38;5;43m20221210130100948 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130100948 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc7e1059c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130100948 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130100948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130100953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130100953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130100955 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130100955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130100955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130100956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:01:02.122332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11206): Terminating (SIGTERM) 13:01:02.171370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11209): Terminating (SIGTERM) 13:01:02.222647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11212): Terminating (SIGTERM) 13:01:02.265420 --- ParallelTerminationStrategy: PID 11206 died... 13:01:02.285397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11206): Terminated: ok {rc=0} 13:01:02.332705 --- ParallelTerminationStrategy: PID 11209 died... 13:01:02.352740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11209): Terminated: ok {rc=0} 13:01:02.397795 --- ParallelTerminationStrategy: PID 11212 died... 13:01:02.416204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11212): Terminated: ok {rc=0} 13:01:02.502964 bus /sierra_3: Setting Powered False 13:01:03.600924 bus /sierra_3: Setting Powered False 13:01:04.712834 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:01:05.960098 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:01:05.966264 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:01:05.999109 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:01:06.025422 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:01:06.075608 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:01:06.107985 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:01:06.134174 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:01:06.688024 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:01:06.738828 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:01:06.750523 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:01:06.820454 tst mo_mt_call.py: using LAC 28569 13:01:06.945063 tst mo_mt_call.py: using RAC 9 13:01:07.069512 tst mo_mt_call.py: using CellId 28569 13:01:07.188138 tst mo_mt_call.py: using BVCI 28570 13:01:07.296845 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:01:07.307717 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:01:07.318370 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:01:07.329488 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:01:07.340458 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:01:07.351482 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:01:07.470304 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:01:07.585139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:08.046752 run create_hlr_db(pid=11219): Launched 13:01:08.160409 bus /sierra_2: Setting Powered False 13:01:09.220597 run create_hlr_db(pid=11219): Terminated: ok {rc=0} 13:01:09.634604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11221): Launched 13:01:09.931669 run osmo-hlr_10.42.42.2(pid=11222): Launched 13:01:10.046047 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:10.568873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11224): Launched 13:01:10.865106 run osmo-stp_10.42.42.5(pid=11225): Launched 13:01:10.978799 run osmo-msc_10.42.42.6: Starting osmo-msc 13:01:11.515278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11227): Launched 13:01:11.812163 run osmo-msc_10.42.42.6(pid=11228): Launched 13:01:11.978681 run osmo-stp_10.42.42.5(pid=11225): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11225)] 13:01:12.105595 run osmo-stp_10.42.42.5(pid=11225): stdout: | (launched: 2022-12-10_13:01:10.811261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:12.231929 run osmo-stp_10.42.42.5(pid=11225): stderr: | [0;m[38;5;43m20221210130110981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130110981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130110981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130110982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130110982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130110982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130110982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:12.355607 run osmo-stp_10.42.42.5(pid=11225): stdout: | (launched: 2022-12-10_13:01:10.811261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:12.473672 run osmo-stp_10.42.42.5(pid=11225): stderr: | [0;m[38;5;43m20221210130110981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130110981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130110981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130110982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130110982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130110982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130110982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:12.614689 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11225): Process ended prematurely: osmo-stp_10.42.42.5(pid=11225) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11225)] [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:01:12.623584 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 13:01:12.649910 run osmo-hlr_10.42.42.2(pid=11222): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11222)] 13:01:12.697358 run osmo-hlr_10.42.42.2(pid=11222): stdout: | (launched: 2022-12-10_13:01:09.877853) 13:01:12.746183 run osmo-hlr_10.42.42.2(pid=11222): stderr: | [0;m[1;31m20221210130110053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130110053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130110053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130110053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130110053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130110053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130110064 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130110073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130110074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130110074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:12.814661 run osmo-msc_10.42.42.6(pid=11228): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11228)] 13:01:12.861817 run osmo-msc_10.42.42.6(pid=11228): stdout: | (launched: 2022-12-10_13:01:11.757069) 13:01:12.910447 run osmo-msc_10.42.42.6(pid=11228): stderr: | [0;m[38;5;43m20221210130112030 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130112030 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffae7b3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130112030 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130112030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130112030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130112030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130112032 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130112033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130112033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130112033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:01:12.959532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11221): Terminating (SIGTERM) 13:01:12.998913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11224): Terminating (SIGTERM) 13:01:13.038493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11227): Terminating (SIGTERM) 13:01:13.077993 --- ParallelTerminationStrategy: PID 11221 died... 13:01:13.096661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11221): Terminated: ok {rc=0} 13:01:13.140913 --- ParallelTerminationStrategy: PID 11224 died... 13:01:13.159196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11224): Terminated: ok {rc=0} 13:01:13.203174 --- ParallelTerminationStrategy: PID 11227 died... 13:01:13.221651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11227): Terminated: ok {rc=0} 13:01:13.307023 bus /sierra_3: Setting Powered False 13:01:14.405747 bus /sierra_3: Setting Powered False 13:01:15.520372 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:01:16.674764 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:01:16.687862 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:01:16.758576 tst mo_mt_call_osmux.py: using LAC 28570 13:01:16.885900 tst mo_mt_call_osmux.py: using RAC 10 13:01:17.042472 tst mo_mt_call_osmux.py: using CellId 28570 13:01:17.168586 tst mo_mt_call_osmux.py: using BVCI 28571 13:01:17.288445 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:01:17.299872 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:01:17.311037 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:01:17.322301 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:01:17.333654 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:01:17.344740 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:01:17.462806 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:01:17.578378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:18.041205 run create_hlr_db(pid=11230): Launched 13:01:18.155143 bus /sierra_2: Setting Powered False 13:01:19.215922 run create_hlr_db(pid=11230): Terminated: ok {rc=0} 13:01:19.631733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11232): Launched 13:01:19.929501 run osmo-hlr_10.42.42.2(pid=11233): Launched 13:01:20.043977 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:20.577632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11235): Launched 13:01:20.875386 run osmo-stp_10.42.42.5(pid=11236): Launched 13:01:20.989383 run osmo-msc_10.42.42.6: Starting osmo-msc 13:01:21.534357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11238): Launched 13:01:21.832891 run osmo-msc_10.42.42.6(pid=11239): Launched 13:01:22.000424 run osmo-stp_10.42.42.5(pid=11236): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11236)] 13:01:22.127748 run osmo-stp_10.42.42.5(pid=11236): stdout: | (launched: 2022-12-10_13:01:20.820897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:22.255041 run osmo-stp_10.42.42.5(pid=11236): stderr: | [0;m[38;5;43m20221210130120991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130120991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130120991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130120992 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130120992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130120992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130120993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:22.379713 run osmo-stp_10.42.42.5(pid=11236): stdout: | (launched: 2022-12-10_13:01:20.820897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:22.498530 run osmo-stp_10.42.42.5(pid=11236): stderr: | [0;m[38;5;43m20221210130120991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130120991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130120991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130120992 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130120992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130120992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130120993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:22.640917 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11236): Process ended prematurely: osmo-stp_10.42.42.5(pid=11236) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11236)] [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:01:22.649962 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:01:22.676264 run osmo-hlr_10.42.42.2(pid=11233): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11233)] 13:01:22.723869 run osmo-hlr_10.42.42.2(pid=11233): stdout: | (launched: 2022-12-10_13:01:19.874984) 13:01:22.772746 run osmo-hlr_10.42.42.2(pid=11233): stderr: | [0;m[1;31m20221210130120055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130120055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130120055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130120055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130120055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130120055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130120070 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130120080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130120081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130120081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:22.841335 run osmo-msc_10.42.42.6(pid=11239): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11239)] 13:01:22.888911 run osmo-msc_10.42.42.6(pid=11239): stdout: | (launched: 2022-12-10_13:01:21.778219) 13:01:22.937919 run osmo-msc_10.42.42.6(pid=11239): stderr: | [0;m[38;5;43m20221210130122049 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130122049 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6781fa9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130122049 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130122049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130122049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130122050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130122052 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130122052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130122052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130122052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:01:22.987329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11232): Terminating (SIGTERM) 13:01:23.026685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11235): Terminating (SIGTERM) 13:01:23.066848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11238): Terminating (SIGTERM) 13:01:23.106916 --- ParallelTerminationStrategy: PID 11232 died... 13:01:23.125974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11232): Terminated: ok {rc=0} 13:01:23.170199 --- ParallelTerminationStrategy: PID 11235 died... 13:01:23.188529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11235): Terminated: ok {rc=0} 13:01:23.232858 --- ParallelTerminationStrategy: PID 11238 died... 13:01:23.251621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11238): Terminated: ok {rc=0} 13:01:23.333966 bus /sierra_3: Setting Powered False 13:01:24.431718 bus /sierra_3: Setting Powered False 13:01:25.546564 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:01:26.795970 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:01:26.803227 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:01:26.836630 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:01:26.863352 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:01:26.914677 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:01:26.947858 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:01:26.974678 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:01:27.526535 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:01:27.577438 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:01:27.588771 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:01:27.657898 tst mo_mt_call.py: using LAC 28571 13:01:27.784901 tst mo_mt_call.py: using RAC 11 13:01:27.912387 tst mo_mt_call.py: using CellId 28571 13:01:28.037851 tst mo_mt_call.py: using BVCI 28572 13:01:28.155325 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:01:28.166650 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:01:28.177901 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:01:28.189031 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:01:28.200262 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:01:28.211514 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:01:28.326822 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:01:28.441924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:28.906213 run create_hlr_db(pid=11244): Launched 13:01:29.020865 bus /sierra_2: Setting Powered False 13:01:30.083907 run create_hlr_db(pid=11244): Terminated: ok {rc=0} 13:01:30.510255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11246): Launched 13:01:30.807832 run osmo-hlr_10.42.42.2(pid=11247): Launched 13:01:30.975804 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:31.657960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Launched 13:01:31.974167 run osmo-stp_10.42.42.5(pid=11250): Launched 13:01:32.159009 run osmo-msc_10.42.42.6: Starting osmo-msc 13:01:32.839367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11252): Launched 13:01:33.137604 run osmo-msc_10.42.42.6(pid=11253): Launched 13:01:33.305653 run osmo-stp_10.42.42.5(pid=11250): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] 13:01:33.433959 run osmo-stp_10.42.42.5(pid=11250): stdout: | (launched: 2022-12-10_13:01:31.916195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:33.561767 run osmo-stp_10.42.42.5(pid=11250): stderr: | [0;m[38;5;43m20221210130132243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130132243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130132244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130132244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130132246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130132247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130132247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:33.687057 run osmo-stp_10.42.42.5(pid=11250): stdout: | (launched: 2022-12-10_13:01:31.916195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:33.806551 run osmo-stp_10.42.42.5(pid=11250): stderr: | [0;m[38;5;43m20221210130132243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130132243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130132244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130132244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130132246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130132247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130132247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:33.949675 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11250): Process ended prematurely: osmo-stp_10.42.42.5(pid=11250) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:01:33.958571 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:01:33.984904 run osmo-hlr_10.42.42.2(pid=11247): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11247)] 13:01:34.032276 run osmo-hlr_10.42.42.2(pid=11247): stdout: | (launched: 2022-12-10_13:01:30.753804) 13:01:34.081182 run osmo-hlr_10.42.42.2(pid=11247): stderr: | [0;m[1;31m20221210130131018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130131018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130131018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130131018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130131018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130131018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130131035 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130131043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130131043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130131043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:34.148985 run osmo-msc_10.42.42.6(pid=11253): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11253)] 13:01:34.196338 run osmo-msc_10.42.42.6(pid=11253): stdout: | (launched: 2022-12-10_13:01:33.083372) 13:01:34.245157 run osmo-msc_10.42.42.6(pid=11253): stderr: | [0;m[38;5;43m20221210130133353 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130133353 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd34c35fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130133353 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130133353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130133353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130133354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130133356 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130133356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130133357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130133357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:01:34.294307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11246): Terminating (SIGTERM) 13:01:34.333528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Terminating (SIGTERM) 13:01:34.373035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11252): Terminating (SIGTERM) 13:01:34.412559 --- ParallelTerminationStrategy: PID 11246 died... 13:01:34.431343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11246): Terminated: ok {rc=0} 13:01:34.474994 --- ParallelTerminationStrategy: PID 11249 died... 13:01:34.493236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Terminated: ok {rc=0} 13:01:34.537191 --- ParallelTerminationStrategy: PID 11252 died... 13:01:34.555660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11252): Terminated: ok {rc=0} 13:01:34.638885 bus /sierra_3: Setting Powered False 13:01:35.737301 bus /sierra_3: Setting Powered False 13:01:36.852801 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:01:38.000395 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:01:38.012271 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:01:38.082415 tst mo_mt_call_osmux.py: using LAC 28572 13:01:38.208405 tst mo_mt_call_osmux.py: using RAC 12 13:01:38.335705 tst mo_mt_call_osmux.py: using CellId 28572 13:01:38.460887 tst mo_mt_call_osmux.py: using BVCI 28573 13:01:38.576543 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:01:38.587955 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:01:38.599030 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:01:38.610266 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:01:38.621519 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:01:38.632576 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:01:38.746991 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:01:38.865489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:39.356906 run create_hlr_db(pid=11255): Launched 13:01:39.484615 bus /sierra_2: Setting Powered False 13:01:40.547595 run create_hlr_db(pid=11255): Terminated: ok {rc=0} 13:01:40.970735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11257): Launched 13:01:41.268581 run osmo-hlr_10.42.42.2(pid=11258): Launched 13:01:41.382993 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:41.908365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11260): Launched 13:01:42.204504 run osmo-stp_10.42.42.5(pid=11261): Launched 13:01:42.318054 run osmo-msc_10.42.42.6: Starting osmo-msc 13:01:42.856544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11263): Launched 13:01:43.155800 run osmo-msc_10.42.42.6(pid=11264): Launched 13:01:43.323204 run osmo-stp_10.42.42.5(pid=11261): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11261)] 13:01:43.450868 run osmo-stp_10.42.42.5(pid=11261): stdout: | (launched: 2022-12-10_13:01:42.150659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:43.577509 run osmo-stp_10.42.42.5(pid=11261): stderr: | [0;m[38;5;43m20221210130142319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130142319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130142319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130142319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130142322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130142322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130142322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:43.702154 run osmo-stp_10.42.42.5(pid=11261): stdout: | (launched: 2022-12-10_13:01:42.150659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:43.820656 run osmo-stp_10.42.42.5(pid=11261): stderr: | [0;m[38;5;43m20221210130142319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130142319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130142319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130142319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130142322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130142322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130142322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:43.962678 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11261): Process ended prematurely: osmo-stp_10.42.42.5(pid=11261) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11261)] [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:01:43.971457 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:01:43.997682 run osmo-hlr_10.42.42.2(pid=11258): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11258)] 13:01:44.045196 run osmo-hlr_10.42.42.2(pid=11258): stdout: | (launched: 2022-12-10_13:01:41.214621) 13:01:44.094110 run osmo-hlr_10.42.42.2(pid=11258): stderr: | [0;m[1;31m20221210130141390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130141390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130141390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130141390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130141390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130141390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130141402 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130141411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130141411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130141412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:44.162577 run osmo-msc_10.42.42.6(pid=11264): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11264)] 13:01:44.209869 run osmo-msc_10.42.42.6(pid=11264): stdout: | (launched: 2022-12-10_13:01:43.101454) 13:01:44.258971 run osmo-msc_10.42.42.6(pid=11264): stderr: | [0;m[38;5;43m20221210130143374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130143374 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa6d3c78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130143374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130143374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130143374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130143374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130143376 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130143377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130143377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130143377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:01:44.308285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11257): Terminating (SIGTERM) 13:01:44.347852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11260): Terminating (SIGTERM) 13:01:44.387466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11263): Terminating (SIGTERM) 13:01:44.427207 --- ParallelTerminationStrategy: PID 11257 died... 13:01:44.446089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11257): Terminated: ok {rc=0} 13:01:44.490546 --- ParallelTerminationStrategy: PID 11260 died... 13:01:44.508706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11260): Terminated: ok {rc=0} 13:01:44.552409 --- ParallelTerminationStrategy: PID 11263 died... 13:01:44.570679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11263): Terminated: ok {rc=0} 13:01:44.655410 bus /sierra_3: Setting Powered False 13:01:45.753120 bus /sierra_3: Setting Powered False 13:01:46.878311 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:01:48.131400 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:01:48.138572 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:01:48.171744 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:01:48.198668 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:01:48.251404 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:01:48.285125 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:01:48.312052 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:01:48.864474 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:01:48.916349 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:01:48.927767 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:01:48.998749 tst mo_mt_call.py: using LAC 28573 13:01:49.123609 tst mo_mt_call.py: using RAC 13 13:01:49.242279 tst mo_mt_call.py: using CellId 28573 13:01:49.360091 tst mo_mt_call.py: using BVCI 28574 13:01:49.470382 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:01:49.481382 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:01:49.492026 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:01:49.502925 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:01:49.514039 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:01:49.524830 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:01:49.644840 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:01:49.759529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:50.222485 run create_hlr_db(pid=11269): Launched 13:01:50.336357 bus /sierra_2: Setting Powered False 13:01:51.396050 run create_hlr_db(pid=11269): Terminated: ok {rc=0} 13:01:51.810896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11271): Launched 13:01:52.108484 run osmo-hlr_10.42.42.2(pid=11272): Launched 13:01:52.222493 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:52.748815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11274): Launched 13:01:53.045658 run osmo-stp_10.42.42.5(pid=11275): Launched 13:01:53.160843 run osmo-msc_10.42.42.6: Starting osmo-msc 13:01:53.707335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11277): Launched 13:01:54.006465 run osmo-msc_10.42.42.6(pid=11278): Launched 13:01:54.174737 run osmo-stp_10.42.42.5(pid=11275): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11275)] 13:01:54.301888 run osmo-stp_10.42.42.5(pid=11275): stdout: | (launched: 2022-12-10_13:01:52.991272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:54.429230 run osmo-stp_10.42.42.5(pid=11275): stderr: | [0;m[38;5;43m20221210130153159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130153159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130153159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130153160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130153162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130153162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130153162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:54.553762 run osmo-stp_10.42.42.5(pid=11275): stdout: | (launched: 2022-12-10_13:01:52.991272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:54.672415 run osmo-stp_10.42.42.5(pid=11275): stderr: | [0;m[38;5;43m20221210130153159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130153159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130153159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130153160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130153162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130153162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130153162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:54.815006 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11275): Process ended prematurely: osmo-stp_10.42.42.5(pid=11275) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11275)] [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:01:54.823605 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 13:01:54.850195 run osmo-hlr_10.42.42.2(pid=11272): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11272)] 13:01:54.897355 run osmo-hlr_10.42.42.2(pid=11272): stdout: | (launched: 2022-12-10_13:01:52.054328) 13:01:54.946076 run osmo-hlr_10.42.42.2(pid=11272): stderr: | [0;m[1;31m20221210130152231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130152231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130152231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130152231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130152231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130152231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130152243 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130152252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130152252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130152252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:55.013495 run osmo-msc_10.42.42.6(pid=11278): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11278)] 13:01:55.060425 run osmo-msc_10.42.42.6(pid=11278): stdout: | (launched: 2022-12-10_13:01:53.951957) 13:01:55.108923 run osmo-msc_10.42.42.6(pid=11278): stderr: | [0;m[38;5;43m20221210130154221 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130154222 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7635bafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130154222 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130154222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130154222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130154222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130154225 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130154225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130154225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130154226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:01:55.158351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11271): Terminating (SIGTERM) 13:01:55.196904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11274): Terminating (SIGTERM) 13:01:55.235595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11277): Terminating (SIGTERM) 13:01:55.274611 --- ParallelTerminationStrategy: PID 11271 died... 13:01:55.293093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11271): Terminated: ok {rc=0} 13:01:55.336096 --- ParallelTerminationStrategy: PID 11274 died... 13:01:55.354151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11274): Terminated: ok {rc=0} 13:01:55.397783 --- ParallelTerminationStrategy: PID 11277 died... 13:01:55.415974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11277): Terminated: ok {rc=0} 13:01:55.502652 bus /sierra_3: Setting Powered False 13:01:56.602248 bus /sierra_3: Setting Powered False 13:01:57.714046 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:01:58.861410 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:01:58.873505 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:01:58.943488 tst mo_mt_call_osmux.py: using LAC 28574 13:01:59.070549 tst mo_mt_call_osmux.py: using RAC 14 13:01:59.197443 tst mo_mt_call_osmux.py: using CellId 28574 13:01:59.322584 tst mo_mt_call_osmux.py: using BVCI 28575 13:01:59.440226 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:01:59.451599 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:01:59.462887 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:01:59.474041 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:01:59.485266 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:01:59.496352 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:01:59.615585 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:01:59.729630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:00.191549 run create_hlr_db(pid=11280): Launched 13:02:00.306470 bus /sierra_2: Setting Powered False 13:02:01.373657 run create_hlr_db(pid=11280): Terminated: ok {rc=0} 13:02:01.849538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11282): Launched 13:02:02.265871 run osmo-hlr_10.42.42.2(pid=11283): Launched 13:02:02.386072 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:02.903865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11285): Launched 13:02:03.202097 run osmo-stp_10.42.42.5(pid=11286): Launched 13:02:03.315697 run osmo-msc_10.42.42.6: Starting osmo-msc 13:02:03.856156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11288): Launched 13:02:04.153584 run osmo-msc_10.42.42.6(pid=11289): Launched 13:02:04.321743 run osmo-stp_10.42.42.5(pid=11286): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11286)] 13:02:04.449327 run osmo-stp_10.42.42.5(pid=11286): stdout: | (launched: 2022-12-10_13:02:03.147023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:04.576327 run osmo-stp_10.42.42.5(pid=11286): stderr: | [0;m[38;5;43m20221210130203317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130203317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130203317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130203318 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130203318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130203318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130203318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:04.701101 run osmo-stp_10.42.42.5(pid=11286): stdout: | (launched: 2022-12-10_13:02:03.147023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:04.819588 run osmo-stp_10.42.42.5(pid=11286): stderr: | [0;m[38;5;43m20221210130203317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130203317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130203317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130203318 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130203318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130203318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130203318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:04.961865 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11286): Process ended prematurely: osmo-stp_10.42.42.5(pid=11286) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11286)] [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:02:04.970400 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:02:04.996732 run osmo-hlr_10.42.42.2(pid=11283): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11283)] 13:02:05.044134 run osmo-hlr_10.42.42.2(pid=11283): stdout: | (launched: 2022-12-10_13:02:02.194870) 13:02:05.093322 run osmo-hlr_10.42.42.2(pid=11283): stderr: | [0;m[1;31m20221210130202386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130202386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130202386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130202387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130202387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130202387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130202398 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130202406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130202406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130202406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:05.161881 run osmo-msc_10.42.42.6(pid=11289): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11289)] 13:02:05.209620 run osmo-msc_10.42.42.6(pid=11289): stdout: | (launched: 2022-12-10_13:02:04.099041) 13:02:05.258737 run osmo-msc_10.42.42.6(pid=11289): stderr: | [0;m[38;5;43m20221210130204368 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130204368 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7eff2018ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130204369 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130204369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130204369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130204369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130204371 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130204371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130204371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130204371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:02:05.308125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11282): Terminating (SIGTERM) 13:02:05.347755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11285): Terminating (SIGTERM) 13:02:05.387413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11288): Terminating (SIGTERM) 13:02:05.427199 --- ParallelTerminationStrategy: PID 11282 died... 13:02:05.445999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11282): Terminated: ok {rc=0} 13:02:05.489860 --- ParallelTerminationStrategy: PID 11285 died... 13:02:05.507998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11285): Terminated: ok {rc=0} 13:02:05.551714 --- ParallelTerminationStrategy: PID 11288 died... 13:02:05.570183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11288): Terminated: ok {rc=0} 13:02:05.655478 bus /sierra_3: Setting Powered False 13:02:06.752917 bus /sierra_3: Setting Powered False 13:02:07.867514 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:02:09.118485 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:02:09.125362 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:02:09.158878 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:02:09.185784 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:02:09.237147 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:02:09.270635 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:02:09.297605 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:02:09.849961 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:02:09.900549 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:02:09.912075 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:02:09.981381 tst mo_mt_call.py: using LAC 28575 13:02:10.106899 tst mo_mt_call.py: using RAC 15 13:02:10.236663 tst mo_mt_call.py: using CellId 28575 13:02:10.365954 tst mo_mt_call.py: using BVCI 28576 13:02:10.482971 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:02:10.494379 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:02:10.505537 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:02:10.516684 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:02:10.528056 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:02:10.539215 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:02:10.654299 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:02:10.769882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:11.232041 run create_hlr_db(pid=11294): Launched 13:02:11.346310 bus /sierra_2: Setting Powered False 13:02:12.405774 run create_hlr_db(pid=11294): Terminated: ok {rc=0} 13:02:12.820512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11296): Launched 13:02:13.116872 run osmo-hlr_10.42.42.2(pid=11297): Launched 13:02:13.230616 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:13.756495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11299): Launched 13:02:14.052865 run osmo-stp_10.42.42.5(pid=11300): Launched 13:02:14.166874 run osmo-msc_10.42.42.6: Starting osmo-msc 13:02:14.705260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11302): Launched 13:02:15.001742 run osmo-msc_10.42.42.6(pid=11303): Launched 13:02:15.167446 run osmo-stp_10.42.42.5(pid=11300): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11300)] 13:02:15.293785 run osmo-stp_10.42.42.5(pid=11300): stdout: | (launched: 2022-12-10_13:02:13.998867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:15.420209 run osmo-stp_10.42.42.5(pid=11300): stderr: | [0;m[38;5;43m20221210130214168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130214168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130214168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130214169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130214169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130214169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130214169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:15.544284 run osmo-stp_10.42.42.5(pid=11300): stdout: | (launched: 2022-12-10_13:02:13.998867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:15.662221 run osmo-stp_10.42.42.5(pid=11300): stderr: | [0;m[38;5;43m20221210130214168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130214168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130214168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130214169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130214169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130214169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130214169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:15.803321 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11300): Process ended prematurely: osmo-stp_10.42.42.5(pid=11300) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11300)] [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:02:15.812002 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:02:15.851969 run osmo-hlr_10.42.42.2(pid=11297): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11297)] 13:02:15.912734 run osmo-hlr_10.42.42.2(pid=11297): stdout: | (launched: 2022-12-10_13:02:13.062676) 13:02:15.963052 run osmo-hlr_10.42.42.2(pid=11297): stderr: | [0;m[1;31m20221210130213240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130213240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130213240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130213240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130213240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130213240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130213252 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130213261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130213261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130213261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:16.032672 run osmo-msc_10.42.42.6(pid=11303): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11303)] 13:02:16.082541 run osmo-msc_10.42.42.6(pid=11303): stdout: | (launched: 2022-12-10_13:02:14.947579) 13:02:16.133879 run osmo-msc_10.42.42.6(pid=11303): stderr: | [0;m[38;5;43m20221210130215218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130215218 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f34245eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130215218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130215218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130215219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130215219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130215221 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130215221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130215221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130215221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:02:16.185818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11296): Terminating (SIGTERM) 13:02:16.227847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11299): Terminating (SIGTERM) 13:02:16.271223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11302): Terminating (SIGTERM) 13:02:16.313251 --- ParallelTerminationStrategy: PID 11296 died... 13:02:16.332403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11296): Terminated: ok {rc=0} 13:02:16.379421 --- ParallelTerminationStrategy: PID 11299 died... 13:02:16.398814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11299): Terminated: ok {rc=0} 13:02:16.446300 --- ParallelTerminationStrategy: PID 11302 died... 13:02:16.465781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11302): Terminated: ok {rc=0} 13:02:16.552720 bus /sierra_3: Setting Powered False 13:02:17.649687 bus /sierra_3: Setting Powered False 13:02:18.765786 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:02:19.910304 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:02:19.921795 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:02:19.989637 tst mo_mt_call_osmux.py: using LAC 28576 13:02:20.115328 tst mo_mt_call_osmux.py: using RAC 16 13:02:20.240245 tst mo_mt_call_osmux.py: using CellId 28576 13:02:20.366540 tst mo_mt_call_osmux.py: using BVCI 28577 13:02:20.482335 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:02:20.493975 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:02:20.505345 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:02:20.516509 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:02:20.527828 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:02:20.539077 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:02:20.654458 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:02:20.768174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:21.231769 run create_hlr_db(pid=11305): Launched 13:02:21.346336 bus /sierra_2: Setting Powered False 13:02:22.406367 run create_hlr_db(pid=11305): Terminated: ok {rc=0} 13:02:22.843252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11307): Launched 13:02:23.160878 run osmo-hlr_10.42.42.2(pid=11308): Launched 13:02:23.282769 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:23.833947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11310): Launched 13:02:24.150688 run osmo-stp_10.42.42.5(pid=11311): Launched 13:02:24.272144 run osmo-msc_10.42.42.6: Starting osmo-msc 13:02:24.848281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11313): Launched 13:02:25.165389 run osmo-msc_10.42.42.6(pid=11314): Launched 13:02:25.343660 run osmo-stp_10.42.42.5(pid=11311): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11311)] 13:02:25.479842 run osmo-stp_10.42.42.5(pid=11311): stdout: | (launched: 2022-12-10_13:02:24.093144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:25.614953 run osmo-stp_10.42.42.5(pid=11311): stderr: | [0;m[38;5;43m20221210130224285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130224285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130224285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130224286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130224286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130224286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130224286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:25.749403 run osmo-stp_10.42.42.5(pid=11311): stdout: | (launched: 2022-12-10_13:02:24.093144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:25.876824 run osmo-stp_10.42.42.5(pid=11311): stderr: | [0;m[38;5;43m20221210130224285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130224285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130224285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130224286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130224286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130224286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130224286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:26.028895 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11311): Process ended prematurely: osmo-stp_10.42.42.5(pid=11311) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11311)] [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:02:26.038359 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:02:26.065926 run osmo-hlr_10.42.42.2(pid=11308): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11308)] 13:02:26.116047 run osmo-hlr_10.42.42.2(pid=11308): stdout: | (launched: 2022-12-10_13:02:23.103500) 13:02:26.168020 run osmo-hlr_10.42.42.2(pid=11308): stderr: | [0;m[1;31m20221210130223299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130223299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130223299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130223299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130223299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130223299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130223311 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130223319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130223319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130223319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:26.240238 run osmo-msc_10.42.42.6(pid=11314): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11314)] 13:02:26.290320 run osmo-msc_10.42.42.6(pid=11314): stdout: | (launched: 2022-12-10_13:02:25.107792) 13:02:26.342095 run osmo-msc_10.42.42.6(pid=11314): stderr: | [0;m[38;5;43m20221210130225432 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130225432 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5fc2340c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130225432 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130225432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130225432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130225433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130225434 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130225435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130225435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130225435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:02:26.393952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11307): Terminating (SIGTERM) 13:02:26.435408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11310): Terminating (SIGTERM) 13:02:26.477048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11313): Terminating (SIGTERM) 13:02:26.518749 --- ParallelTerminationStrategy: PID 11307 died... 13:02:26.538583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11307): Terminated: ok {rc=0} 13:02:26.584658 --- ParallelTerminationStrategy: PID 11310 died... 13:02:26.604064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11310): Terminated: ok {rc=0} 13:02:26.650215 --- ParallelTerminationStrategy: PID 11313 died... 13:02:26.669531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11313): Terminated: ok {rc=0} 13:02:26.755384 bus /sierra_3: Setting Powered False 13:02:27.852558 bus /sierra_3: Setting Powered False 13:02:28.967956 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:02:30.220219 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:02:30.227997 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:02:30.261145 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:02:30.287313 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:02:30.335689 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:02:30.368109 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:02:30.394407 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:02:30.967775 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:02:31.019212 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:02:31.031222 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:02:31.100692 tst mo_mt_call.py: using LAC 28577 13:02:31.227413 tst mo_mt_call.py: using RAC 17 13:02:31.349802 tst mo_mt_call.py: using CellId 28577 13:02:31.503929 tst mo_mt_call.py: using BVCI 28578 13:02:31.643528 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:02:31.656515 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:02:31.670175 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:02:31.683210 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:02:31.696349 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:02:31.708146 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:02:31.845101 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:02:31.977857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:32.473350 run create_hlr_db(pid=11319): Launched 13:02:32.588828 bus /sierra_2: Setting Powered False 13:02:33.648542 run create_hlr_db(pid=11319): Terminated: ok {rc=0} 13:02:34.083449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11321): Launched 13:02:34.399420 run osmo-hlr_10.42.42.2(pid=11322): Launched 13:02:34.520727 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:35.067604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11324): Launched 13:02:35.383146 run osmo-stp_10.42.42.5(pid=11325): Launched 13:02:35.504616 run osmo-msc_10.42.42.6: Starting osmo-msc 13:02:36.080329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11329): Launched 13:02:36.396678 run osmo-msc_10.42.42.6(pid=11330): Launched 13:02:36.574658 run osmo-stp_10.42.42.5(pid=11325): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11325)] 13:02:36.708582 run osmo-stp_10.42.42.5(pid=11325): stdout: | (launched: 2022-12-10_13:02:35.326013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:36.843947 run osmo-stp_10.42.42.5(pid=11325): stderr: | [0;m[38;5;43m20221210130235517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130235518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130235518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130235518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130235519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130235519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130235519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:36.977873 run osmo-stp_10.42.42.5(pid=11325): stdout: | (launched: 2022-12-10_13:02:35.326013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:37.104045 run osmo-stp_10.42.42.5(pid=11325): stderr: | [0;m[38;5;43m20221210130235517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130235518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130235518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130235518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130235519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130235519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130235519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:37.254567 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11325): Process ended prematurely: osmo-stp_10.42.42.5(pid=11325) [trial-2375↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11325)] [trial-2375↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:02:37.263767 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:02:37.291261 run osmo-hlr_10.42.42.2(pid=11322): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11322)] 13:02:37.341135 run osmo-hlr_10.42.42.2(pid=11322): stdout: | (launched: 2022-12-10_13:02:34.342239) 13:02:37.391890 run osmo-hlr_10.42.42.2(pid=11322): stderr: | [0;m[1;31m20221210130234540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130234540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130234540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130234540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130234540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130234540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130234553 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130234561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130234561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130234562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:37.463239 run osmo-msc_10.42.42.6(pid=11330): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11330)] 13:02:37.512723 run osmo-msc_10.42.42.6(pid=11330): stdout: | (launched: 2022-12-10_13:02:36.339518) 13:02:37.563793 run osmo-msc_10.42.42.6(pid=11330): stderr: | [0;m[38;5;43m20221210130236662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130236662 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4564b05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130236663 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130236663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130236663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130236663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130236665 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130236665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130236665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130236665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:02:37.614949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11321): Terminating (SIGTERM) 13:02:37.655922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11324): Terminating (SIGTERM) 13:02:37.696876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11329): Terminating (SIGTERM) 13:02:37.738270 --- ParallelTerminationStrategy: PID 11321 died... 13:02:37.757456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11321): Terminated: ok {rc=0} 13:02:37.802798 --- ParallelTerminationStrategy: PID 11324 died... 13:02:37.822270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11324): Terminated: ok {rc=0} 13:02:37.867337 --- ParallelTerminationStrategy: PID 11329 died... 13:02:37.886692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11329): Terminated: ok {rc=0} 13:02:37.973326 bus /sierra_3: Setting Powered False 13:02:39.072172 bus /sierra_3: Setting Powered False 13:02:40.186705 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:02:41.327627 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:02:41.339062 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:02:41.408055 tst mo_mt_call_osmux.py: using LAC 28578 13:02:41.529780 tst mo_mt_call_osmux.py: using RAC 18 13:02:41.647546 tst mo_mt_call_osmux.py: using CellId 28578 13:02:41.764290 tst mo_mt_call_osmux.py: using BVCI 28579 13:02:41.873214 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:02:41.884103 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:02:41.894864 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:02:41.905945 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:02:41.916893 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:02:41.927847 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:02:42.044132 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:02:42.159418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:42.621658 run create_hlr_db(pid=11332): Launched 13:02:42.735262 bus /sierra_2: Setting Powered False 13:02:43.795010 run create_hlr_db(pid=11332): Terminated: ok {rc=0} 13:02:44.229863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11334): Launched 13:02:44.547115 run osmo-hlr_10.42.42.2(pid=11335): Launched 13:02:44.669685 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:45.222556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11337): Launched 13:02:45.540170 run osmo-stp_10.42.42.5(pid=11338): Launched 13:02:45.663261 run osmo-msc_10.42.42.6: Starting osmo-msc 13:02:46.242368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11340): Launched 13:02:46.562659 run osmo-msc_10.42.42.6(pid=11341): Launched 13:02:46.875758 run osmo-stp_10.42.42.5(pid=11338): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11338)] 13:02:47.239406 run osmo-stp_10.42.42.5(pid=11338): stdout: | (launched: 2022-12-10_13:02:45.482165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:47.381344 run osmo-stp_10.42.42.5(pid=11338): stderr: | [0;m[38;5;43m20221210130245675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130245675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130245675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130245676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130245676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130245676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130245676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:47.507612 run osmo-stp_10.42.42.5(pid=11338): stdout: | (launched: 2022-12-10_13:02:45.482165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:47.627183 run osmo-stp_10.42.42.5(pid=11338): stderr: | [0;m[38;5;43m20221210130245675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130245675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130245675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130245676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130245676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130245676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130245676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:47.770361 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11338): Process ended prematurely: osmo-stp_10.42.42.5(pid=11338) [trial-2375↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11338)] [trial-2375↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:02:47.779303 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:02:47.807240 run osmo-hlr_10.42.42.2(pid=11335): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11335)] 13:02:47.856094 run osmo-hlr_10.42.42.2(pid=11335): stdout: | (launched: 2022-12-10_13:02:44.489704) 13:02:47.906391 run osmo-hlr_10.42.42.2(pid=11335): stderr: | [0;m[1;31m20221210130244688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130244688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130244688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130244688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130244688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130244688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130244700 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130244708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130244709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130244709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:47.976180 run osmo-msc_10.42.42.6(pid=11341): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11341)] 13:02:48.024807 run osmo-msc_10.42.42.6(pid=11341): stdout: | (launched: 2022-12-10_13:02:46.501905) 13:02:48.074966 run osmo-msc_10.42.42.6(pid=11341): stderr: | [0;m[38;5;43m20221210130247074 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130247075 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa8f60b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130247075 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130247075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130247075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130247075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130247080 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130247081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130247081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130247081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:02:48.125476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11334): Terminating (SIGTERM) 13:02:48.165724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11337): Terminating (SIGTERM) 13:02:48.206284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11340): Terminating (SIGTERM) 13:02:48.246686 --- ParallelTerminationStrategy: PID 11334 died... 13:02:48.265561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11334): Terminated: ok {rc=0} 13:02:48.310835 --- ParallelTerminationStrategy: PID 11337 died... 13:02:48.329299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11337): Terminated: ok {rc=0} 13:02:48.374136 --- ParallelTerminationStrategy: PID 11340 died... 13:02:48.392653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11340): Terminated: ok {rc=0} 13:02:48.478963 bus /sierra_3: Setting Powered False 13:02:49.576741 bus /sierra_3: Setting Powered False 13:02:50.691089 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:02:51.938874 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:02:51.945475 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:02:51.978928 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:02:52.005124 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:02:52.053921 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:02:52.086053 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:02:52.112481 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:02:52.666160 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:02:52.715567 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:02:52.726409 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:02:52.796564 tst mo_mt_call.py: using LAC 28579 13:02:52.914319 tst mo_mt_call.py: using RAC 19 13:02:53.030649 tst mo_mt_call.py: using CellId 28579 13:02:53.152206 tst mo_mt_call.py: using BVCI 28580 13:02:53.262942 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:02:53.273734 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:02:53.284202 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:02:53.294968 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:02:53.305834 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:02:53.316614 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:02:53.431410 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:02:53.545336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:54.008541 run create_hlr_db(pid=11346): Launched 13:02:54.123038 bus /sierra_2: Setting Powered False 13:02:55.183131 run create_hlr_db(pid=11346): Terminated: ok {rc=0} 13:02:55.618815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11348): Launched 13:02:55.936666 run osmo-hlr_10.42.42.2(pid=11349): Launched 13:02:56.058835 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:56.612014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11351): Launched 13:02:56.930025 run osmo-stp_10.42.42.5(pid=11352): Launched 13:02:57.050813 run osmo-msc_10.42.42.6: Starting osmo-msc 13:02:57.625510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11354): Launched 13:02:57.944821 run osmo-msc_10.42.42.6(pid=11355): Launched 13:02:58.123069 run osmo-stp_10.42.42.5(pid=11352): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11352)] 13:02:58.257850 run osmo-stp_10.42.42.5(pid=11352): stdout: | (launched: 2022-12-10_13:02:56.871834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:58.393394 run osmo-stp_10.42.42.5(pid=11352): stderr: | [0;m[38;5;43m20221210130257064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130257064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130257064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130257064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130257065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130257065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130257065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:58.527651 run osmo-stp_10.42.42.5(pid=11352): stdout: | (launched: 2022-12-10_13:02:56.871834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:58.654380 run osmo-stp_10.42.42.5(pid=11352): stderr: | [0;m[38;5;43m20221210130257064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130257064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130257064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130257064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130257065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130257065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130257065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:58.805721 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11352): Process ended prematurely: osmo-stp_10.42.42.5(pid=11352) [trial-2375↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11352)] [trial-2375↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:02:58.815083 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:02:58.842936 run osmo-hlr_10.42.42.2(pid=11349): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11349)] 13:02:58.892349 run osmo-hlr_10.42.42.2(pid=11349): stdout: | (launched: 2022-12-10_13:02:55.879268) 13:02:58.943427 run osmo-hlr_10.42.42.2(pid=11349): stderr: | [0;m[1;31m20221210130256079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130256079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130256079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130256079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130256080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130256080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130256093 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130256101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130256102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130256102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:59.014780 run osmo-msc_10.42.42.6(pid=11355): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11355)] 13:02:59.064395 run osmo-msc_10.42.42.6(pid=11355): stdout: | (launched: 2022-12-10_13:02:57.886795) 13:02:59.115558 run osmo-msc_10.42.42.6(pid=11355): stderr: | [0;m[38;5;43m20221210130258209 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130258209 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4cac9b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130258209 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130258209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130258209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130258209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130258211 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130258211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130258211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130258212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:02:59.167141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11348): Terminating (SIGTERM) 13:02:59.208457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11351): Terminating (SIGTERM) 13:02:59.249997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11354): Terminating (SIGTERM) 13:02:59.291520 --- ParallelTerminationStrategy: PID 11348 died... 13:02:59.310848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11348): Terminated: ok {rc=0} 13:02:59.356618 --- ParallelTerminationStrategy: PID 11351 died... 13:02:59.375822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11351): Terminated: ok {rc=0} 13:02:59.421954 --- ParallelTerminationStrategy: PID 11354 died... 13:02:59.441539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11354): Terminated: ok {rc=0} 13:02:59.528734 bus /sierra_3: Setting Powered False 13:03:00.624744 bus /sierra_3: Setting Powered False 13:03:01.739668 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:03:02.890613 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:03:02.902608 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:03:02.973799 tst mo_mt_call_osmux.py: using LAC 28580 13:03:03.101542 tst mo_mt_call_osmux.py: using RAC 20 13:03:03.222799 tst mo_mt_call_osmux.py: using CellId 28580 13:03:03.341662 tst mo_mt_call_osmux.py: using BVCI 28581 13:03:03.453997 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:03:03.464829 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:03:03.475574 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:03:03.486808 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:03:03.498082 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:03:03.509084 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:03:03.627673 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:03:03.744540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:04.207954 run create_hlr_db(pid=11358): Launched 13:03:04.321767 bus /sierra_2: Setting Powered False 13:03:05.381630 run create_hlr_db(pid=11358): Terminated: ok {rc=0} 13:03:05.817838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11360): Launched 13:03:06.135274 run osmo-hlr_10.42.42.2(pid=11361): Launched 13:03:06.256905 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:06.805980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11363): Launched 13:03:07.124101 run osmo-stp_10.42.42.5(pid=11364): Launched 13:03:07.246158 run osmo-msc_10.42.42.6: Starting osmo-msc 13:03:07.823900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11366): Launched 13:03:08.142437 run osmo-msc_10.42.42.6(pid=11367): Launched 13:03:08.320287 run osmo-stp_10.42.42.5(pid=11364): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11364)] 13:03:08.455567 run osmo-stp_10.42.42.5(pid=11364): stdout: | (launched: 2022-12-10_13:03:07.066234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:08.590519 run osmo-stp_10.42.42.5(pid=11364): stderr: | [0;m[38;5;43m20221210130307259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130307259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130307259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130307260 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130307262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130307262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130307262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:08.724184 run osmo-stp_10.42.42.5(pid=11364): stdout: | (launched: 2022-12-10_13:03:07.066234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:08.851413 run osmo-stp_10.42.42.5(pid=11364): stderr: | [0;m[38;5;43m20221210130307259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130307259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130307259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130307260 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130307262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130307262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130307262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:09.003220 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11364): Process ended prematurely: osmo-stp_10.42.42.5(pid=11364) [trial-2375↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11364)] [trial-2375↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:03:09.012615 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:03:09.040196 run osmo-hlr_10.42.42.2(pid=11361): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11361)] 13:03:09.090118 run osmo-hlr_10.42.42.2(pid=11361): stdout: | (launched: 2022-12-10_13:03:06.077716) 13:03:09.141959 run osmo-hlr_10.42.42.2(pid=11361): stderr: | [0;m[1;31m20221210130306285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130306285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130306285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130306285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130306285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130306285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130306297 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130306307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130306307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130306307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:09.214121 run osmo-msc_10.42.42.6(pid=11367): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11367)] 13:03:09.263843 run osmo-msc_10.42.42.6(pid=11367): stdout: | (launched: 2022-12-10_13:03:08.084726) 13:03:09.315363 run osmo-msc_10.42.42.6(pid=11367): stderr: | [0;m[38;5;43m20221210130308406 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130308406 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6b621f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130308406 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130308406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130308406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130308407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130308408 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130308409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130308409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130308409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:03:09.367029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11360): Terminating (SIGTERM) 13:03:09.408317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11363): Terminating (SIGTERM) 13:03:09.449861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11366): Terminating (SIGTERM) 13:03:09.491532 --- ParallelTerminationStrategy: PID 11360 died... 13:03:09.510913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11360): Terminated: ok {rc=0} 13:03:09.556638 --- ParallelTerminationStrategy: PID 11363 died... 13:03:09.575981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11363): Terminated: ok {rc=0} 13:03:09.621630 --- ParallelTerminationStrategy: PID 11366 died... 13:03:09.640923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11366): Terminated: ok {rc=0} 13:03:09.728202 bus /sierra_3: Setting Powered False 13:03:10.826844 bus /sierra_3: Setting Powered False 13:03:11.942076 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 13:03:13.193186 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:13.198142 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 13:03:13.231167 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 13:03:13.257117 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 13:03:13.308873 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 13:03:13.342851 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 13:03:13.369677 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 13:03:13.914909 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 13:03:13.963378 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:03:13.974195 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 13:03:14.023082 tst mo_mt_call.py: using LAC 28581 13:03:14.142589 tst mo_mt_call.py: using RAC 21 13:03:14.261679 tst mo_mt_call.py: using CellId 28581 13:03:14.382865 tst mo_mt_call.py: using BVCI 28582 13:03:14.493918 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:03:14.504612 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:03:14.515231 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:03:14.526058 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:03:14.536777 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:03:14.547577 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:03:14.664391 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:03:14.780476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:15.244144 run create_hlr_db(pid=11372): Launched 13:03:15.357565 bus /sierra_2: Setting Powered False 13:03:16.415527 run create_hlr_db(pid=11372): Terminated: ok {rc=0} 13:03:16.854830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11374): Launched 13:03:17.161475 run osmo-hlr_10.42.42.2(pid=11375): Launched 13:03:17.277264 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:17.793293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11377): Launched 13:03:18.111769 run osmo-stp_10.42.42.5(pid=11378): Launched 13:03:18.232808 run osmo-msc_10.42.42.6: Starting osmo-msc 13:03:18.807084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11380): Launched 13:03:19.124125 run osmo-msc_10.42.42.6(pid=11381): Launched 13:03:19.301275 run osmo-stp_10.42.42.5(pid=11378): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11378)] 13:03:19.436263 run osmo-stp_10.42.42.5(pid=11378): stdout: | (launched: 2022-12-10_13:03:18.054542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:19.571151 run osmo-stp_10.42.42.5(pid=11378): stderr: | [0;m[38;5;43m20221210130318245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130318246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130318246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130318246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130318247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130318247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130318247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:19.704834 run osmo-stp_10.42.42.5(pid=11378): stdout: | (launched: 2022-12-10_13:03:18.054542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:19.831285 run osmo-stp_10.42.42.5(pid=11378): stderr: | [0;m[38;5;43m20221210130318245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130318246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130318246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130318246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130318247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130318247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130318247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:19.982715 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11378): Process ended prematurely: osmo-stp_10.42.42.5(pid=11378) [trial-2375↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11378)] [trial-2375↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 13:03:19.992088 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:03:20.019331 run osmo-hlr_10.42.42.2(pid=11375): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11375)] 13:03:20.069405 run osmo-hlr_10.42.42.2(pid=11375): stdout: | (launched: 2022-12-10_13:03:17.106788) 13:03:20.120640 run osmo-hlr_10.42.42.2(pid=11375): stderr: | [0;m[1;31m20221210130317279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130317279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130317279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130317279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130317279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130317279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130317300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130317310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130317310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130317310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:20.192298 run osmo-msc_10.42.42.6(pid=11381): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11381)] 13:03:20.242023 run osmo-msc_10.42.42.6(pid=11381): stdout: | (launched: 2022-12-10_13:03:19.066630) 13:03:20.293332 run osmo-msc_10.42.42.6(pid=11381): stderr: | [0;m[38;5;43m20221210130319387 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130319387 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8be9d45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130319387 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130319387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130319387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130319388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130319389 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130319390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130319390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130319390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:03:20.344919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11374): Terminating (SIGTERM) 13:03:20.386187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11377): Terminating (SIGTERM) 13:03:20.427688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11380): Terminating (SIGTERM) 13:03:20.469241 --- ParallelTerminationStrategy: PID 11374 died... 13:03:20.488638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11374): Terminated: ok {rc=0} 13:03:20.534202 --- ParallelTerminationStrategy: PID 11377 died... 13:03:20.553372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11377): Terminated: ok {rc=0} 13:03:20.599157 --- ParallelTerminationStrategy: PID 11380 died... 13:03:20.618323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11380): Terminated: ok {rc=0} 13:03:20.704276 bus /sierra_3: Setting Powered False 13:03:21.802588 bus /sierra_3: Setting Powered False 13:03:22.916643 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 13:03:24.063474 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:03:24.075290 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 13:03:24.129066 tst mo_mt_call_osmux.py: using LAC 28582 13:03:24.255126 tst mo_mt_call_osmux.py: using RAC 22 13:03:24.382728 tst mo_mt_call_osmux.py: using CellId 28582 13:03:24.508575 tst mo_mt_call_osmux.py: using BVCI 28583 13:03:24.625418 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:03:24.636632 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:03:24.647635 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:03:24.658644 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:03:24.669693 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:03:24.680698 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:03:24.794938 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:03:24.909858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:25.373393 run create_hlr_db(pid=11383): Launched 13:03:25.487910 bus /sierra_2: Setting Powered False 13:03:26.548660 run create_hlr_db(pid=11383): Terminated: ok {rc=0} 13:03:26.982877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11385): Launched 13:03:27.300344 run osmo-hlr_10.42.42.2(pid=11386): Launched 13:03:27.422441 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:27.973631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11388): Launched 13:03:28.292437 run osmo-stp_10.42.42.5(pid=11389): Launched 13:03:28.413857 run osmo-msc_10.42.42.6: Starting osmo-msc 13:03:28.989195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11391): Launched 13:03:29.305969 run osmo-msc_10.42.42.6(pid=11392): Launched 13:03:29.483907 run osmo-stp_10.42.42.5(pid=11389): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11389)] 13:03:29.618559 run osmo-stp_10.42.42.5(pid=11389): stdout: | (launched: 2022-12-10_13:03:28.234587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:29.752707 run osmo-stp_10.42.42.5(pid=11389): stderr: | [0;m[38;5;43m20221210130328425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130328425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130328425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130328426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130328426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130328426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130328426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:29.886791 run osmo-stp_10.42.42.5(pid=11389): stdout: | (launched: 2022-12-10_13:03:28.234587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:30.013518 run osmo-stp_10.42.42.5(pid=11389): stderr: | [0;m[38;5;43m20221210130328425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130328425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130328425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130328426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130328426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130328426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130328426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:30.164565 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11389): Process ended prematurely: osmo-stp_10.42.42.5(pid=11389) [trial-2375↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11389)] [trial-2375↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 13:03:30.173781 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:03:30.200895 run osmo-hlr_10.42.42.2(pid=11386): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11386)] 13:03:30.250420 run osmo-hlr_10.42.42.2(pid=11386): stdout: | (launched: 2022-12-10_13:03:27.242618) 13:03:30.301619 run osmo-hlr_10.42.42.2(pid=11386): stderr: | [0;m[1;31m20221210130327439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130327439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130327439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130327439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130327439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130327439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130327454 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130327462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130327463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130327463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:30.372735 run osmo-msc_10.42.42.6(pid=11392): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11392)] 13:03:30.421804 run osmo-msc_10.42.42.6(pid=11392): stdout: | (launched: 2022-12-10_13:03:29.248105) 13:03:30.472401 run osmo-msc_10.42.42.6(pid=11392): stderr: | [0;m[38;5;43m20221210130329570 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130329570 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbbe2361c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130329570 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130329570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130329571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130329571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130329572 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130329573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130329573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130329573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:03:30.523757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11385): Terminating (SIGTERM) 13:03:30.564741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11388): Terminating (SIGTERM) 13:03:30.605754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11391): Terminating (SIGTERM) 13:03:30.646907 --- ParallelTerminationStrategy: PID 11385 died... 13:03:30.666427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11385): Terminated: ok {rc=0} 13:03:30.711636 --- ParallelTerminationStrategy: PID 11388 died... 13:03:30.730662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11388): Terminated: ok {rc=0} 13:03:30.775602 --- ParallelTerminationStrategy: PID 11391 died... 13:03:30.794941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11391): Terminated: ok {rc=0} 13:03:30.903922 bus /sierra_3: Setting Powered False 13:03:32.002847 bus /sierra_3: Setting Powered False 13:03:33.116507 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:03:34.361966 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:34.369514 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:03:34.402666 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 13:03:34.429494 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 13:03:34.482148 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:03:34.515868 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 13:03:34.542709 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 13:03:35.090807 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 13:03:35.140150 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:03:35.151476 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:03:35.202795 tst mo_mt_call.py: using LAC 28583 13:03:35.322893 tst mo_mt_call.py: using RAC 23 13:03:35.444066 tst mo_mt_call.py: using CellId 28583 13:03:35.561801 tst mo_mt_call.py: using BVCI 28584 13:03:35.671406 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:03:35.682930 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:03:35.694052 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:03:35.705610 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:03:35.717238 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:03:35.728633 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:03:35.847522 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:03:35.969822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:36.465327 run create_hlr_db(pid=11398): Launched 13:03:36.595420 bus /sierra_2: Setting Powered False 13:03:37.658316 run create_hlr_db(pid=11398): Terminated: ok {rc=0} 13:03:38.086405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11400): Launched 13:03:38.385400 run osmo-hlr_10.42.42.2(pid=11401): Launched 13:03:38.500436 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:39.030102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11403): Launched 13:03:39.328301 run osmo-stp_10.42.42.5(pid=11404): Launched 13:03:39.442953 run osmo-msc_10.42.42.6: Starting osmo-msc 13:03:39.983250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11406): Launched 13:03:40.282071 run osmo-msc_10.42.42.6(pid=11407): Launched 13:03:40.448836 run osmo-stp_10.42.42.5(pid=11404): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11404)] 13:03:40.583665 run osmo-stp_10.42.42.5(pid=11404): stdout: | (launched: 2022-12-10_13:03:39.273402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:40.722370 run osmo-stp_10.42.42.5(pid=11404): stderr: | [0;m[38;5;43m20221210130339445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130339446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130339446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130339446 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130339447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130339447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130339447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:40.847654 run osmo-stp_10.42.42.5(pid=11404): stdout: | (launched: 2022-12-10_13:03:39.273402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:40.966289 run osmo-stp_10.42.42.5(pid=11404): stderr: | [0;m[38;5;43m20221210130339445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130339446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130339446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130339446 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130339447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130339447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130339447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:41.108284 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11404): Process ended prematurely: osmo-stp_10.42.42.5(pid=11404) [trial-2375↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11404)] [trial-2375↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 13:03:41.117355 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:03:41.143944 run osmo-hlr_10.42.42.2(pid=11401): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11401)] 13:03:41.192433 run osmo-hlr_10.42.42.2(pid=11401): stdout: | (launched: 2022-12-10_13:03:38.330768) 13:03:41.241918 run osmo-hlr_10.42.42.2(pid=11401): stderr: | [0;m[1;31m20221210130338509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130338509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130338509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130338509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130338509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130338509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130338519 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130338528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130338528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130338528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:41.310689 run osmo-msc_10.42.42.6(pid=11407): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11407)] 13:03:41.358324 run osmo-msc_10.42.42.6(pid=11407): stdout: | (launched: 2022-12-10_13:03:40.227310) 13:03:41.407445 run osmo-msc_10.42.42.6(pid=11407): stderr: | [0;m[38;5;43m20221210130340499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130340499 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f64b346bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130340499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130340499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130340499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130340499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130340503 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130340503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130340503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130340503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:03:41.456860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11400): Terminating (SIGTERM) 13:03:41.496438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11403): Terminating (SIGTERM) 13:03:41.536098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11406): Terminating (SIGTERM) 13:03:41.576140 --- ParallelTerminationStrategy: PID 11400 died... 13:03:41.595145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11400): Terminated: ok {rc=0} 13:03:41.639624 --- ParallelTerminationStrategy: PID 11403 died... 13:03:41.658171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11403): Terminated: ok {rc=0} 13:03:41.702154 --- ParallelTerminationStrategy: PID 11406 died... 13:03:41.720655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11406): Terminated: ok {rc=0} 13:03:41.803584 bus /sierra_3: Setting Powered False 13:03:42.900169 bus /sierra_3: Setting Powered False 13:03:44.016276 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 13:03:45.162930 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:03:45.175074 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:03:45.228608 tst mo_mt_call_osmux.py: using LAC 28584 13:03:45.357180 tst mo_mt_call_osmux.py: using RAC 24 13:03:45.482106 tst mo_mt_call_osmux.py: using CellId 28584 13:03:45.607289 tst mo_mt_call_osmux.py: using BVCI 28585 13:03:45.719206 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:03:45.730571 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:03:45.741761 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:03:45.753930 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:03:45.766099 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:03:45.778042 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:03:45.929714 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:03:46.061737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:46.594734 run create_hlr_db(pid=11409): Launched 13:03:46.714414 bus /sierra_2: Setting Powered False 13:03:47.774341 run create_hlr_db(pid=11409): Terminated: ok {rc=0} 13:03:48.210511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11411): Launched 13:03:48.527912 run osmo-hlr_10.42.42.2(pid=11412): Launched 13:03:48.648865 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:49.195560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11414): Launched 13:03:49.512287 run osmo-stp_10.42.42.5(pid=11415): Launched 13:03:49.634877 run osmo-msc_10.42.42.6: Starting osmo-msc 13:03:50.214039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11417): Launched 13:03:50.532355 run osmo-msc_10.42.42.6(pid=11418): Launched 13:03:50.709826 run osmo-stp_10.42.42.5(pid=11415): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11415)] 13:03:50.843460 run osmo-stp_10.42.42.5(pid=11415): stdout: | (launched: 2022-12-10_13:03:49.454801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:50.978650 run osmo-stp_10.42.42.5(pid=11415): stderr: | [0;m[38;5;43m20221210130349646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130349646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130349647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130349647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130349647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130349647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130349648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:51.112409 run osmo-stp_10.42.42.5(pid=11415): stdout: | (launched: 2022-12-10_13:03:49.454801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:51.238703 run osmo-stp_10.42.42.5(pid=11415): stderr: | [0;m[38;5;43m20221210130349646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130349646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130349647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130349647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130349647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130349647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130349648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:51.390299 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11415): Process ended prematurely: osmo-stp_10.42.42.5(pid=11415) [trial-2375↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11415)] [trial-2375↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 13:03:51.399563 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:03:51.426907 run osmo-hlr_10.42.42.2(pid=11412): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11412)] 13:03:51.476647 run osmo-hlr_10.42.42.2(pid=11412): stdout: | (launched: 2022-12-10_13:03:48.470159) 13:03:51.528102 run osmo-hlr_10.42.42.2(pid=11412): stderr: | [0;m[1;31m20221210130348671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130348671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130348671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130348671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130348671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130348671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130348683 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130348691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130348691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130348691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:51.600314 run osmo-msc_10.42.42.6(pid=11418): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11418)] 13:03:51.650230 run osmo-msc_10.42.42.6(pid=11418): stdout: | (launched: 2022-12-10_13:03:50.474722) 13:03:51.701821 run osmo-msc_10.42.42.6(pid=11418): stderr: | [0;m[38;5;43m20221210130350799 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130350799 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff10ed07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130350799 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130350799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130350799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130350800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130350801 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130350802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130350802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130350802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:03:51.753810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11411): Terminating (SIGTERM) 13:03:51.795442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11414): Terminating (SIGTERM) 13:03:51.837228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11417): Terminating (SIGTERM) 13:03:51.879515 --- ParallelTerminationStrategy: PID 11411 died... 13:03:51.899021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11411): Terminated: ok {rc=0} 13:03:51.945154 --- ParallelTerminationStrategy: PID 11414 died... 13:03:51.964293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11414): Terminated: ok {rc=0} 13:03:52.010000 --- ParallelTerminationStrategy: PID 11417 died... 13:03:52.029280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11417): Terminated: ok {rc=0} 13:03:52.116875 bus /sierra_3: Setting Powered False 13:03:53.213854 bus /sierra_3: Setting Powered False 13:03:54.329124 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 emergency:trx-b200 --------------------------------------------------------------------- 13:03:55.574847 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:55.579258 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 13:03:55.612548 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 13:03:55.638549 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 13:03:55.721983 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 13:03:55.754461 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 13:03:55.781026 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 13:03:56.361527 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2375 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 13:03:56.366616 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:03:56.377353 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 13:03:56.426417 tst emergency_mo_mt_call.py: using LAC 28585 13:03:56.545099 tst emergency_mo_mt_call.py: using RAC 25 13:03:56.662003 tst emergency_mo_mt_call.py: using CellId 28585 13:03:56.779313 tst emergency_mo_mt_call.py: using BVCI 28586 13:03:56.886385 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:03:56.896860 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:03:56.907236 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:03:56.918029 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:03:56.928669 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:03:56.939539 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:03:57.052718 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:03:57.168120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:57.620675 run create_hlr_db(pid=11423): Launched 13:03:57.732252 bus /sierra_2: Setting Powered False 13:03:58.790395 run create_hlr_db(pid=11423): Terminated: ok {rc=0} 13:03:59.199372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11425): Launched 13:03:59.491968 run osmo-hlr_10.42.42.2(pid=11426): Launched 13:03:59.603511 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:00.120190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11428): Launched 13:04:00.415907 run osmo-stp_10.42.42.5(pid=11429): Launched 13:04:00.537623 tst emergency_mo_mt_call.py: using MSISDN 7751 13:04:00.704770 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:01.279509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11431): Launched 13:04:01.600134 run osmo-msc_10.42.42.6(pid=11432): Launched 13:04:01.921873 run osmo-stp_10.42.42.5(pid=11429): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11429)] 13:04:02.172627 run osmo-stp_10.42.42.5(pid=11429): stdout: | (launched: 2022-12-10_13:04:00.362188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:02.308465 run osmo-stp_10.42.42.5(pid=11429): stderr: | [0;m[38;5;43m20221210130400533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130400533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130400533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130400534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130400534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130400534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130400535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:02.433455 run osmo-stp_10.42.42.5(pid=11429): stdout: | (launched: 2022-12-10_13:04:00.362188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:02.551205 run osmo-stp_10.42.42.5(pid=11429): stderr: | [0;m[38;5;43m20221210130400533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130400533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130400533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130400534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130400534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130400534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130400535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:02.691612 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=11429): Process ended prematurely: osmo-stp_10.42.42.5(pid=11429) [trial-2375↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11429)] [trial-2375↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 13:04:02.700060 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 13:04:02.726406 run osmo-hlr_10.42.42.2(pid=11426): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11426)] 13:04:02.774905 run osmo-hlr_10.42.42.2(pid=11426): stdout: | (launched: 2022-12-10_13:03:59.438611) 13:04:02.824533 run osmo-hlr_10.42.42.2(pid=11426): stderr: | [0;m[1;31m20221210130359613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130359613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130359613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130359613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130359613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130359613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130359625 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130359633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130359633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130359633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:02.893566 run osmo-msc_10.42.42.6(pid=11432): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11432)] 13:04:02.941525 run osmo-msc_10.42.42.6(pid=11432): stdout: | (launched: 2022-12-10_13:04:01.532934) 13:04:02.990748 run osmo-msc_10.42.42.6(pid=11432): stderr: | [0;m[38;5;43m20221210130402103 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130402104 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f00e93e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130402104 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130402104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130402104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130402104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130402106 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130402106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130402107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130402107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:03.040371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11425): Terminating (SIGTERM) 13:04:03.080212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11428): Terminating (SIGTERM) 13:04:03.120280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11431): Terminating (SIGTERM) 13:04:03.160530 --- ParallelTerminationStrategy: PID 11425 died... 13:04:03.179550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11425): Terminated: ok {rc=0} 13:04:03.224066 --- ParallelTerminationStrategy: PID 11428 died... 13:04:03.242781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11428): Terminated: ok {rc=0} 13:04:03.286895 --- ParallelTerminationStrategy: PID 11431 died... 13:04:03.305419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11431): Terminated: ok {rc=0} 13:04:03.390835 bus /sierra_3: Setting Powered False 13:04:04.488144 bus /sierra_3: Setting Powered False 13:04:05.602877 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 13:04:06.690285 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:06.702375 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 13:04:06.753342 tst emergency_preemptive_call.py: using LAC 28586 13:04:06.880405 tst emergency_preemptive_call.py: using RAC 26 13:04:07.002602 tst emergency_preemptive_call.py: using CellId 28586 13:04:07.123250 tst emergency_preemptive_call.py: using BVCI 28587 13:04:07.236358 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:07.247277 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:07.258104 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:07.268749 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:07.279491 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:07.290229 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:04:07.403832 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:04:07.518402 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:04:07.631862 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:04:07.749217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:08.235958 run create_hlr_db(pid=11434): Launched 13:04:08.362737 bus /sierra_2: Setting Powered False 13:04:09.425240 run create_hlr_db(pid=11434): Terminated: ok {rc=0} 13:04:09.844936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11436): Launched 13:04:10.138986 run osmo-hlr_10.42.42.2(pid=11437): Launched 13:04:10.252028 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:10.768617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11439): Launched 13:04:11.061480 run osmo-stp_10.42.42.5(pid=11440): Launched 13:04:11.187350 tst emergency_preemptive_call.py: using MSISDN 7752 13:04:11.339853 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:11.866934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11442): Launched 13:04:12.199610 run osmo-msc_10.42.42.6(pid=11443): Launched 13:04:12.375130 run osmo-stp_10.42.42.5(pid=11440): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11440)] 13:04:12.507840 run osmo-stp_10.42.42.5(pid=11440): stdout: | (launched: 2022-12-10_13:04:11.007580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:12.641589 run osmo-stp_10.42.42.5(pid=11440): stderr: | [0;m[38;5;43m20221210130411178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130411178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130411178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130411179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130411179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130411179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130411179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:12.773843 run osmo-stp_10.42.42.5(pid=11440): stdout: | (launched: 2022-12-10_13:04:11.007580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:12.898873 run osmo-stp_10.42.42.5(pid=11440): stderr: | [0;m[38;5;43m20221210130411178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130411178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130411178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130411179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130411179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130411179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130411179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:13.047870 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=11440): Process ended prematurely: osmo-stp_10.42.42.5(pid=11440) [trial-2375↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11440)] [trial-2375↪emergency:trx-b200↪emergency_preemptive_call.py:32] 13:04:13.056675 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 13:04:13.083930 run osmo-hlr_10.42.42.2(pid=11437): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11437)] 13:04:13.134329 run osmo-hlr_10.42.42.2(pid=11437): stdout: | (launched: 2022-12-10_13:04:10.085338) 13:04:13.186370 run osmo-hlr_10.42.42.2(pid=11437): stderr: | [0;m[1;31m20221210130410259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130410259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130410259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130410260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130410260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130410260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130410283 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130410293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130410293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130410293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:13.259153 run osmo-msc_10.42.42.6(pid=11443): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11443)] 13:04:13.309498 run osmo-msc_10.42.42.6(pid=11443): stdout: | (launched: 2022-12-10_13:04:12.142960) 13:04:13.361525 run osmo-msc_10.42.42.6(pid=11443): stderr: | [0;m[38;5;43m20221210130412464 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130412464 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fad988e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130412464 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130412464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130412464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130412465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130412466 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130412467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130412467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130412467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:13.413616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11436): Terminating (SIGTERM) 13:04:13.455072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11439): Terminating (SIGTERM) 13:04:13.496700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11442): Terminating (SIGTERM) 13:04:13.538985 --- ParallelTerminationStrategy: PID 11436 died... 13:04:13.558967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11436): Terminated: ok {rc=0} 13:04:13.605044 --- ParallelTerminationStrategy: PID 11439 died... 13:04:13.624434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11439): Terminated: ok {rc=0} 13:04:13.670495 --- ParallelTerminationStrategy: PID 11442 died... 13:04:13.689961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11442): Terminated: ok {rc=0} 13:04:13.777719 bus /sierra_9: Setting Powered False 13:04:14.875323 bus /sierra_9: Setting Powered False 13:04:15.992620 bus /sierra_8: Setting Powered False 13:04:17.091800 bus /sierra_8: Setting Powered False 13:04:18.211223 bus /sierra_3: Setting Powered False 13:04:19.309938 bus /sierra_3: Setting Powered False 13:04:20.425911 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-b200 --------------------------------------------------------------------- 13:04:21.709589 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:04:21.714038 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 13:04:21.747015 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 13:04:21.785560 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 13:04:21.874620 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 13:04:21.908553 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 13:04:21.946431 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 13:04:22.535286 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 13:04:22.586876 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:22.597707 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:04:22.649129 tst cs_paging_gprs_active.py: using LAC 28587 13:04:22.773988 tst cs_paging_gprs_active.py: using RAC 27 13:04:22.898395 tst cs_paging_gprs_active.py: using CellId 28587 13:04:23.022576 tst cs_paging_gprs_active.py: using BVCI 28588 13:04:23.134050 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:23.144576 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:23.155012 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:23.165893 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:23.176621 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:23.187359 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:23.198676 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:23.208795 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:23.219421 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:04:23.334150 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:04:23.453643 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:04:23.669275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:04:23.989638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11448): Launched 13:04:24.267119 run iperf3-srv_10.42.42.10(pid=11449): Launched 13:04:24.387371 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:04:24.602545 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:04:24.923596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11450): Launched 13:04:25.201330 run iperf3-srv_10.42.42.10(pid=11451): Launched 13:04:25.321411 tst cs_paging_gprs_active.py:38: start network... 13:04:25.535809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:26.032736 run create_hlr_db(pid=11452): Launched 13:04:26.163127 bus /sierra_2: Setting Powered False 13:04:27.226547 run create_hlr_db(pid=11452): Terminated: ok {rc=0} 13:04:27.654546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11454): Launched 13:04:27.954109 run osmo-hlr_10.42.42.2(pid=11455): Launched 13:04:28.068306 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:28.600798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11457): Launched 13:04:28.901536 run osmo-stp_10.42.42.5(pid=11458): Launched 13:04:29.017517 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:04:29.538550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11460): Launched 13:04:29.653797 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:04:29.908112 run patchelf(pid=11461): Launched 13:04:30.075453 run osmo-stp_10.42.42.5(pid=11458): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11458)] 13:04:30.203219 run osmo-stp_10.42.42.5(pid=11458): stdout: | (launched: 2022-12-10_13:04:28.846642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:30.332181 run osmo-stp_10.42.42.5(pid=11458): stderr: | [0;m[38;5;43m20221210130429015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130429015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130429015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130429016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130429016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130429016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130429017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:30.461630 run osmo-stp_10.42.42.5(pid=11458): stdout: | (launched: 2022-12-10_13:04:28.846642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:30.584880 run osmo-stp_10.42.42.5(pid=11458): stderr: | [0;m[38;5;43m20221210130429015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130429015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130429015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130429016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130429016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130429016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130429017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:30.731103 run patchelf(pid=11461): Terminating (SIGINT) 13:04:30.919947 run patchelf(pid=11461): Terminated: ok {rc=0} 13:04:31.045632 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11458): Process ended prematurely: osmo-stp_10.42.42.5(pid=11458) [trial-2375↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11458)] [trial-2375↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 13:04:31.056106 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:04:31.085638 run osmo-hlr_10.42.42.2(pid=11455): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11455)] 13:04:31.134996 run osmo-hlr_10.42.42.2(pid=11455): stdout: | (launched: 2022-12-10_13:04:27.899579) 13:04:31.185726 run osmo-hlr_10.42.42.2(pid=11455): stderr: | [0;m[1;31m20221210130428075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130428075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130428075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130428075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130428075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130428075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130428087 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130428096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130428096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130428096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:31.237196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11448): Terminating (SIGTERM) 13:04:31.279671 run iperf3-srv_10.42.42.10(pid=11449): Terminating (SIGTERM) 13:04:31.324487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11450): Terminating (SIGTERM) 13:04:31.367338 run iperf3-srv_10.42.42.10(pid=11451): Terminating (SIGTERM) 13:04:31.412083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11454): Terminating (SIGTERM) 13:04:31.454362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11457): Terminating (SIGTERM) 13:04:31.496018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11460): Terminating (SIGTERM) 13:04:31.537801 --- ParallelTerminationStrategy: PID 11448 died... 13:04:31.557319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11448): Terminated: ok {rc=0} 13:04:31.603631 --- ParallelTerminationStrategy: PID 11449 died... 13:04:31.622983 run iperf3-srv_10.42.42.10(pid=11449): Terminated {rc=256} 13:04:31.668805 --- ParallelTerminationStrategy: PID 11450 died... 13:04:31.688078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11450): Terminated: ok {rc=0} 13:04:31.734354 --- ParallelTerminationStrategy: PID 11451 died... 13:04:31.753610 run iperf3-srv_10.42.42.10(pid=11451): Terminated {rc=256} 13:04:31.799603 --- ParallelTerminationStrategy: PID 11454 died... 13:04:31.818996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11454): Terminated: ok {rc=0} 13:04:31.864565 --- ParallelTerminationStrategy: PID 11457 died... 13:04:31.884024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11457): Terminated: ok {rc=0} 13:04:31.930365 --- ParallelTerminationStrategy: PID 11460 died... 13:04:31.949949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11460): Terminated: ok {rc=0} 13:04:32.035563 bus /gobi_0: Setting Powered False 13:04:33.130205 bus /gobi_0: Setting Powered False 13:04:34.242946 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200 iperf3.py ---------------------------------------------- 13:04:35.390876 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:35.402319 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:04:35.453830 tst iperf3.py: using LAC 28588 13:04:35.580923 tst iperf3.py: using RAC 28 13:04:35.711589 tst iperf3.py: using CellId 28588 13:04:35.842558 tst iperf3.py: using BVCI 28589 13:04:35.960175 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:35.971071 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:35.981753 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:35.992470 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:36.003063 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:36.013668 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:36.024347 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:36.034968 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:36.045864 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:04:36.160224 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:04:36.361060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:04:36.661702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11462): Launched 13:04:36.922717 run iperf3-srv_10.42.42.10(pid=11463): Launched 13:04:37.035193 tst iperf3.py:8: start network... 13:04:37.235662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:37.697814 run create_hlr_db(pid=11464): Launched 13:04:37.812728 bus /gobi_6: Setting Powered False 13:04:38.872693 run create_hlr_db(pid=11464): Terminated: ok {rc=0} 13:04:39.305769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11466): Launched 13:04:39.623248 run osmo-hlr_10.42.42.2(pid=11467): Launched 13:04:39.746090 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:40.299870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11469): Launched 13:04:40.619235 run osmo-stp_10.42.42.5(pid=11470): Launched 13:04:40.740839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:04:41.291285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11472): Launched 13:04:41.412480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:04:41.680552 run patchelf(pid=11473): Launched 13:04:41.857706 run osmo-stp_10.42.42.5(pid=11470): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11470)] 13:04:41.993447 run osmo-stp_10.42.42.5(pid=11470): stdout: | (launched: 2022-12-10_13:04:40.561382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:42.130037 run osmo-stp_10.42.42.5(pid=11470): stderr: | [0;m[38;5;43m20221210130440752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130440752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130440753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130440753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130440755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130440756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130440756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:42.266657 run osmo-stp_10.42.42.5(pid=11470): stdout: | (launched: 2022-12-10_13:04:40.561382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:42.397601 run osmo-stp_10.42.42.5(pid=11470): stderr: | [0;m[38;5;43m20221210130440752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130440752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130440753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130440753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130440755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130440756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130440756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:42.553463 run patchelf(pid=11473): Terminating (SIGINT) 13:04:42.732283 run patchelf(pid=11473): Terminated: ok {rc=0} 13:04:42.861207 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11470): Process ended prematurely: osmo-stp_10.42.42.5(pid=11470) [trial-2375↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11470)] [trial-2375↪gprs:trx-b200↪iperf3.py:8] 13:04:42.871124 tst iperf3.py:8: Test FAILED (7.5 sec) 13:04:42.899448 run osmo-hlr_10.42.42.2(pid=11467): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11467)] 13:04:42.948624 run osmo-hlr_10.42.42.2(pid=11467): stdout: | (launched: 2022-12-10_13:04:39.565713) 13:04:42.999809 run osmo-hlr_10.42.42.2(pid=11467): stderr: | [0;m[1;31m20221210130439766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130439766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130439766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130439766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130439766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130439766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130439778 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130439786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130439786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130439786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:43.051328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11462): Terminating (SIGTERM) 13:04:43.092658 run iperf3-srv_10.42.42.10(pid=11463): Terminating (SIGTERM) 13:04:43.133909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11466): Terminating (SIGTERM) 13:04:43.175361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11469): Terminating (SIGTERM) 13:04:43.216587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11472): Terminating (SIGTERM) 13:04:43.258177 --- ParallelTerminationStrategy: PID 11462 died... 13:04:43.277930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11462): Terminated: ok {rc=0} 13:04:43.323622 --- ParallelTerminationStrategy: PID 11463 died... 13:04:43.342913 run iperf3-srv_10.42.42.10(pid=11463): Terminated {rc=256} 13:04:43.388150 --- ParallelTerminationStrategy: PID 11466 died... 13:04:43.407622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11466): Terminated: ok {rc=0} 13:04:43.452865 --- ParallelTerminationStrategy: PID 11469 died... 13:04:43.472576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11469): Terminated: ok {rc=0} 13:04:43.518190 --- ParallelTerminationStrategy: PID 11472 died... 13:04:43.537447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11472): Terminated: ok {rc=0} 13:04:43.623941 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 13:04:44.771265 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:44.785999 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:04:44.834261 tst iperf3m4.py: using LAC 28589 13:04:44.963137 tst iperf3m4.py: using RAC 29 13:04:45.091265 tst iperf3m4.py: using CellId 28589 13:04:45.217112 tst iperf3m4.py: using BVCI 28590 13:04:45.333467 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:45.344623 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:45.355498 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:45.366465 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:45.377104 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:45.387672 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:45.398441 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:45.409128 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:04:45.420105 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:04:45.541458 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:04:45.663425 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:04:45.778358 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:04:45.910703 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:04:46.121132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:04:46.438978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11474): Launched 13:04:46.721752 run iperf3-srv_10.42.42.10(pid=11475): Launched 13:04:46.854772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:04:47.078349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:04:47.402278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11476): Launched 13:04:47.679729 run iperf3-srv_10.42.42.10(pid=11477): Launched 13:04:47.799492 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:04:48.015605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:04:48.336101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11478): Launched 13:04:48.613128 run iperf3-srv_10.42.42.10(pid=11479): Launched 13:04:48.732223 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:04:48.947195 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:04:49.266359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11480): Launched 13:04:49.543118 run iperf3-srv_10.42.42.10(pid=11481): Launched 13:04:49.662773 tst iperf3m4.py:8: start network... 13:04:49.877797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:50.376272 run create_hlr_db(pid=11482): Launched 13:04:50.506646 bus /gobi_6: Setting Powered False 13:04:51.570332 run create_hlr_db(pid=11482): Terminated: ok {rc=0} 13:04:51.997092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11484): Launched 13:04:52.295335 run osmo-hlr_10.42.42.2(pid=11485): Launched 13:04:52.410199 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:52.940750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11487): Launched 13:04:53.241448 run osmo-stp_10.42.42.5(pid=11488): Launched 13:04:53.357252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:04:53.877144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11490): Launched 13:04:53.991427 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:04:54.245884 run patchelf(pid=11491): Launched 13:04:54.412196 run osmo-stp_10.42.42.5(pid=11488): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11488)] 13:04:54.539550 run osmo-stp_10.42.42.5(pid=11488): stdout: | (launched: 2022-12-10_13:04:53.186348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:54.668514 run osmo-stp_10.42.42.5(pid=11488): stderr: | [0;m[38;5;43m20221210130453355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130453355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130453356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130453356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130453357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130453357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130453357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:54.797577 run osmo-stp_10.42.42.5(pid=11488): stdout: | (launched: 2022-12-10_13:04:53.186348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:54.921181 run osmo-stp_10.42.42.5(pid=11488): stderr: | [0;m[38;5;43m20221210130453355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130453355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130453356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130453356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130453357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130453357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130453357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:55.067058 run patchelf(pid=11491): Terminating (SIGINT) 13:04:55.235722 run patchelf(pid=11491): Terminated: ok {rc=0} 13:04:55.357224 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11488): Process ended prematurely: osmo-stp_10.42.42.5(pid=11488) [trial-2375↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11488)] [trial-2375↪gprs:trx-b200↪iperf3m4.py:8] 13:04:55.366631 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:04:55.393984 run osmo-hlr_10.42.42.2(pid=11485): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11485)] 13:04:55.441357 run osmo-hlr_10.42.42.2(pid=11485): stdout: | (launched: 2022-12-10_13:04:52.241268) 13:04:55.490066 run osmo-hlr_10.42.42.2(pid=11485): stderr: | [0;m[1;31m20221210130452414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130452414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130452414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130452415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130452415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130452415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130452427 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130452435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130452436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130452436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:55.539301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11474): Terminating (SIGTERM) 13:04:55.578890 run iperf3-srv_10.42.42.10(pid=11475): Terminating (SIGTERM) 13:04:55.618342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11476): Terminating (SIGTERM) 13:04:55.657759 run iperf3-srv_10.42.42.10(pid=11477): Terminating (SIGTERM) 13:04:55.697064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11478): Terminating (SIGTERM) 13:04:55.736309 run iperf3-srv_10.42.42.10(pid=11479): Terminating (SIGTERM) 13:04:55.775420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11480): Terminating (SIGTERM) 13:04:55.814543 run iperf3-srv_10.42.42.10(pid=11481): Terminating (SIGTERM) 13:04:55.853768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11484): Terminating (SIGTERM) 13:04:55.892914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11487): Terminating (SIGTERM) 13:04:55.932184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11490): Terminating (SIGTERM) 13:04:55.971615 --- ParallelTerminationStrategy: PID 11474 died... 13:04:55.990362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11474): Terminated: ok {rc=0} 13:04:56.034361 --- ParallelTerminationStrategy: PID 11475 died... 13:04:56.052855 run iperf3-srv_10.42.42.10(pid=11475): Terminated {rc=256} 13:04:56.096605 --- ParallelTerminationStrategy: PID 11476 died... 13:04:56.115109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11476): Terminated: ok {rc=0} 13:04:56.159077 --- ParallelTerminationStrategy: PID 11477 died... 13:04:56.177391 run iperf3-srv_10.42.42.10(pid=11477): Terminated {rc=256} 13:04:56.221116 --- ParallelTerminationStrategy: PID 11478 died... 13:04:56.239470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11478): Terminated: ok {rc=0} 13:04:56.283673 --- ParallelTerminationStrategy: PID 11479 died... 13:04:56.302147 run iperf3-srv_10.42.42.10(pid=11479): Terminated {rc=256} 13:04:56.346047 --- ParallelTerminationStrategy: PID 11480 died... 13:04:56.364405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11480): Terminated: ok {rc=0} 13:04:56.408042 --- ParallelTerminationStrategy: PID 11481 died... 13:04:56.426511 run iperf3-srv_10.42.42.10(pid=11481): Terminated {rc=256} 13:04:56.470414 --- ParallelTerminationStrategy: PID 11484 died... 13:04:56.488715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11484): Terminated: ok {rc=0} 13:04:56.532156 --- ParallelTerminationStrategy: PID 11487 died... 13:04:56.550574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11487): Terminated: ok {rc=0} 13:04:56.594891 --- ParallelTerminationStrategy: PID 11490 died... 13:04:56.613486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11490): Terminated: ok {rc=0} 13:04:56.699225 bus /gobi_4: Setting Powered False 13:04:57.800938 bus /gobi_4: Setting Powered False 13:04:58.915685 bus /gobi_1: Setting Powered False 13:05:00.013881 bus /gobi_1: Setting Powered False 13:05:01.141948 bus /gobi_0: Setting Powered False 13:05:02.249791 bus /gobi_0: Setting Powered False 13:05:03.365047 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200 ping.py ---------------------------------------------- 13:05:04.467025 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:04.478732 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:05:04.528228 tst ping.py: using LAC 28590 13:05:04.654688 tst ping.py: using RAC 30 13:05:04.778272 tst ping.py: using CellId 28590 13:05:04.903164 tst ping.py: using BVCI 28591 13:05:05.017696 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:05.028393 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:05.039249 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:05.049990 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:05.060547 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:05.071691 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:05.082694 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:05.093658 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:05:05.212729 tst ping.py:19: start network... 13:05:05.423453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:05.907143 run create_hlr_db(pid=11495): Launched 13:05:06.034306 bus /gobi_6: Setting Powered False 13:05:07.096740 run create_hlr_db(pid=11495): Terminated: ok {rc=0} 13:05:07.533405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11497): Launched 13:05:07.847768 run osmo-hlr_10.42.42.2(pid=11498): Launched 13:05:07.962730 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:08.485688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11500): Launched 13:05:08.781521 run osmo-stp_10.42.42.5(pid=11501): Launched 13:05:08.894359 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:05:09.404447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11503): Launched 13:05:09.517414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:05:09.766077 run patchelf(pid=11504): Launched 13:05:09.929298 run osmo-stp_10.42.42.5(pid=11501): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11501)] 13:05:10.054974 run osmo-stp_10.42.42.5(pid=11501): stdout: | (launched: 2022-12-10_13:05:08.727543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:10.182015 run osmo-stp_10.42.42.5(pid=11501): stderr: | [0;m[38;5;43m20221210130508898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130508898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130508898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130508899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130508899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130508899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130508899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:10.309429 run osmo-stp_10.42.42.5(pid=11501): stdout: | (launched: 2022-12-10_13:05:08.727543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:10.431416 run osmo-stp_10.42.42.5(pid=11501): stderr: | [0;m[38;5;43m20221210130508898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130508898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130508898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130508899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130508899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130508899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130508899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:10.575563 run patchelf(pid=11504): Terminating (SIGINT) 13:05:10.742475 run patchelf(pid=11504): Terminated: ok {rc=0} 13:05:10.862059 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11501): Process ended prematurely: osmo-stp_10.42.42.5(pid=11501) [trial-2375↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11501)] [trial-2375↪gprs:trx-b200↪ping.py:22] 13:05:10.870830 tst ping.py:22: Test FAILED (6.4 sec) 13:05:10.897695 run osmo-hlr_10.42.42.2(pid=11498): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11498)] 13:05:10.945465 run osmo-hlr_10.42.42.2(pid=11498): stdout: | (launched: 2022-12-10_13:05:07.790453) 13:05:10.994751 run osmo-hlr_10.42.42.2(pid=11498): stderr: | [0;m[1;31m20221210130507964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130507964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130507964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130507964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130507964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130507964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130507977 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130507985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130507985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130507985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:11.044576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11497): Terminating (SIGTERM) 13:05:11.084192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11500): Terminating (SIGTERM) 13:05:11.124142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11503): Terminating (SIGTERM) 13:05:11.164148 --- ParallelTerminationStrategy: PID 11497 died... 13:05:11.183088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11497): Terminated: ok {rc=0} 13:05:11.227422 --- ParallelTerminationStrategy: PID 11500 died... 13:05:11.246026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11500): Terminated: ok {rc=0} 13:05:11.290028 --- ParallelTerminationStrategy: PID 11503 died... 13:05:11.308531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11503): Terminated: ok {rc=0} 13:05:11.391948 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 13:05:12.478338 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:12.489966 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:05:12.540911 tst ping_idle_ping.py: using LAC 28591 13:05:12.666155 tst ping_idle_ping.py: using RAC 31 13:05:12.792301 tst ping_idle_ping.py: using CellId 28591 13:05:12.916181 tst ping_idle_ping.py: using BVCI 28592 13:05:13.032267 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:13.043288 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:13.054161 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:13.064884 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:13.075593 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:13.086241 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:13.097113 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:05:13.107926 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:05:13.223978 tst ping_idle_ping.py:24: start network... 13:05:13.434933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:13.922622 run create_hlr_db(pid=11505): Launched 13:05:14.050187 bus /gobi_6: Setting Powered False 13:05:15.112649 run create_hlr_db(pid=11505): Terminated: ok {rc=0} 13:05:15.533157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11507): Launched 13:05:15.837679 run osmo-hlr_10.42.42.2(pid=11508): Launched 13:05:16.062268 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:16.729424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11510): Launched 13:05:17.045724 run osmo-stp_10.42.42.5(pid=11511): Launched 13:05:17.258609 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:05:17.773529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11513): Launched 13:05:17.886576 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:05:18.136490 run patchelf(pid=11514): Launched 13:05:18.300312 run osmo-stp_10.42.42.5(pid=11511): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11511)] 13:05:18.425433 run osmo-stp_10.42.42.5(pid=11511): stdout: | (launched: 2022-12-10_13:05:16.975923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:18.552073 run osmo-stp_10.42.42.5(pid=11511): stderr: | [0;m[38;5;43m20221210130517310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130517311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130517311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130517311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130517313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130517314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130517314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:18.678485 run osmo-stp_10.42.42.5(pid=11511): stdout: | (launched: 2022-12-10_13:05:16.975923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:18.800484 run osmo-stp_10.42.42.5(pid=11511): stderr: | [0;m[38;5;43m20221210130517310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130517311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130517311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130517311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130517313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130517314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130517314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:18.944463 run patchelf(pid=11514): Terminating (SIGINT) 13:05:19.111171 run patchelf(pid=11514): Terminated: ok {rc=0} 13:05:19.231176 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11511): Process ended prematurely: osmo-stp_10.42.42.5(pid=11511) [trial-2375↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11511)] [trial-2375↪gprs:trx-b200↪ping_idle_ping.py:27] 13:05:19.239849 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 13:05:19.266911 run osmo-hlr_10.42.42.2(pid=11508): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11508)] 13:05:19.314632 run osmo-hlr_10.42.42.2(pid=11508): stdout: | (launched: 2022-12-10_13:05:15.774710) 13:05:19.364010 run osmo-hlr_10.42.42.2(pid=11508): stderr: | [0;m[1;31m20221210130516027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130516027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130516027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130516027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130516027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130516027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130516044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130516052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130516057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130516057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:19.413606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11507): Terminating (SIGTERM) 13:05:19.453230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11510): Terminating (SIGTERM) 13:05:19.493096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11513): Terminating (SIGTERM) 13:05:19.533147 --- ParallelTerminationStrategy: PID 11507 died... 13:05:19.552254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11507): Terminated: ok {rc=0} 13:05:19.596587 --- ParallelTerminationStrategy: PID 11510 died... 13:05:19.615319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11510): Terminated: ok {rc=0} 13:05:19.659434 --- ParallelTerminationStrategy: PID 11513 died... 13:05:19.677878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11513): Terminated: ok {rc=0} 13:05:19.763302 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 13:05:21.066977 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:05:21.072567 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:05:21.106293 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:05:21.143963 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:05:21.228315 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:05:21.260592 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:05:21.298531 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:05:21.890828 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:05:21.940035 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:21.950822 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:05:22.000077 tst cs_paging_gprs_active.py: using LAC 28592 13:05:22.121711 tst cs_paging_gprs_active.py: using RAC 32 13:05:22.249715 tst cs_paging_gprs_active.py: using CellId 28592 13:05:22.370527 tst cs_paging_gprs_active.py: using BVCI 28593 13:05:22.481769 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:22.492526 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:22.503169 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:22.514075 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:22.524616 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:22.535186 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:22.545999 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:22.556529 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:22.567241 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:05:22.685744 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:05:22.803527 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:05:23.019449 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:05:23.339843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11519): Launched 13:05:23.618169 run iperf3-srv_10.42.42.10(pid=11520): Launched 13:05:23.738187 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:05:23.954380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:05:24.275365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11521): Launched 13:05:24.553262 run iperf3-srv_10.42.42.10(pid=11522): Launched 13:05:24.673366 tst cs_paging_gprs_active.py:38: start network... 13:05:24.888908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:25.386351 run create_hlr_db(pid=11523): Launched 13:05:25.516371 bus /gobi_6: Setting Powered False 13:05:26.580098 run create_hlr_db(pid=11523): Terminated: ok {rc=0} 13:05:27.008516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11525): Launched 13:05:27.310447 run osmo-hlr_10.42.42.2(pid=11526): Launched 13:05:27.435253 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:27.992845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11528): Launched 13:05:28.313418 run osmo-stp_10.42.42.5(pid=11529): Launched 13:05:28.436213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:05:28.991801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11531): Launched 13:05:29.114846 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:05:29.386167 run patchelf(pid=11532): Launched 13:05:29.563785 run osmo-stp_10.42.42.5(pid=11529): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11529)] 13:05:29.699188 run osmo-stp_10.42.42.5(pid=11529): stdout: | (launched: 2022-12-10_13:05:28.254654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:29.836361 run osmo-stp_10.42.42.5(pid=11529): stderr: | [0;m[38;5;43m20221210130528448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130528448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130528448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130528449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130528449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130528449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130528449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:29.974126 run osmo-stp_10.42.42.5(pid=11529): stdout: | (launched: 2022-12-10_13:05:28.254654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:30.105635 run osmo-stp_10.42.42.5(pid=11529): stderr: | [0;m[38;5;43m20221210130528448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130528448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130528448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130528449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130528449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130528449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130528449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:30.261636 run patchelf(pid=11532): Terminating (SIGINT) 13:05:30.440807 run patchelf(pid=11532): Terminated: ok {rc=0} 13:05:30.570676 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11529): Process ended prematurely: osmo-stp_10.42.42.5(pid=11529) [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11529)] [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:05:30.580667 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:05:30.609061 run osmo-hlr_10.42.42.2(pid=11526): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11526)] 13:05:30.659069 run osmo-hlr_10.42.42.2(pid=11526): stdout: | (launched: 2022-12-10_13:05:27.254615) 13:05:30.710654 run osmo-hlr_10.42.42.2(pid=11526): stderr: | [0;m[1;31m20221210130527447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130527447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130527447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130527447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130527447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130527447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130527460 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130527468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130527468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130527469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:30.762485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11519): Terminating (SIGTERM) 13:05:30.804234 run iperf3-srv_10.42.42.10(pid=11520): Terminating (SIGTERM) 13:05:30.860583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11521): Terminating (SIGTERM) 13:05:30.903520 run iperf3-srv_10.42.42.10(pid=11522): Terminating (SIGTERM) 13:05:30.946758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11525): Terminating (SIGTERM) 13:05:30.988903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11528): Terminating (SIGTERM) 13:05:31.031445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11531): Terminating (SIGTERM) 13:05:31.073816 --- ParallelTerminationStrategy: PID 11519 died... 13:05:31.093813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11519): Terminated: ok {rc=0} 13:05:31.140917 --- ParallelTerminationStrategy: PID 11520 died... 13:05:31.160756 run iperf3-srv_10.42.42.10(pid=11520): Terminated {rc=256} 13:05:31.207618 --- ParallelTerminationStrategy: PID 11521 died... 13:05:31.227507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11521): Terminated: ok {rc=0} 13:05:31.274350 --- ParallelTerminationStrategy: PID 11522 died... 13:05:31.294238 run iperf3-srv_10.42.42.10(pid=11522): Terminated {rc=256} 13:05:31.341442 --- ParallelTerminationStrategy: PID 11525 died... 13:05:31.361304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11525): Terminated: ok {rc=0} 13:05:31.408884 --- ParallelTerminationStrategy: PID 11528 died... 13:05:31.428907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11528): Terminated: ok {rc=0} 13:05:31.476309 --- ParallelTerminationStrategy: PID 11531 died... 13:05:31.496730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11531): Terminated: ok {rc=0} 13:05:31.585549 bus /gobi_0: Setting Powered False 13:05:32.684204 bus /gobi_0: Setting Powered False 13:05:33.798439 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:05:34.947319 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:34.959200 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:05:35.012510 tst iperf3.py: using LAC 28593 13:05:35.138875 tst iperf3.py: using RAC 33 13:05:35.264572 tst iperf3.py: using CellId 28593 13:05:35.391705 tst iperf3.py: using BVCI 28594 13:05:35.509815 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:35.520930 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:35.531862 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:35.542752 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:35.553769 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:35.564459 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:35.575475 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:35.586272 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:35.597289 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:05:35.712571 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:05:35.915258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:05:36.217219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11533): Launched 13:05:36.478619 run iperf3-srv_10.42.42.10(pid=11534): Launched 13:05:36.592465 tst iperf3.py:8: start network... 13:05:36.794536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:37.261294 run create_hlr_db(pid=11535): Launched 13:05:37.376932 bus /gobi_6: Setting Powered False 13:05:38.437104 run create_hlr_db(pid=11535): Terminated: ok {rc=0} 13:05:38.856247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11537): Launched 13:05:39.154979 run osmo-hlr_10.42.42.2(pid=11538): Launched 13:05:39.269576 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:39.787557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11540): Launched 13:05:40.087278 run osmo-stp_10.42.42.5(pid=11541): Launched 13:05:40.202240 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:05:40.719353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11543): Launched 13:05:40.833577 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:05:41.086679 run patchelf(pid=11544): Launched 13:05:41.252881 run osmo-stp_10.42.42.5(pid=11541): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11541)] 13:05:41.379448 run osmo-stp_10.42.42.5(pid=11541): stdout: | (launched: 2022-12-10_13:05:40.032404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:41.508063 run osmo-stp_10.42.42.5(pid=11541): stderr: | [0;m[38;5;43m20221210130540201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130540201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130540201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130540202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130540202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130540202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130540202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:41.637643 run osmo-stp_10.42.42.5(pid=11541): stdout: | (launched: 2022-12-10_13:05:40.032404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:41.760840 run osmo-stp_10.42.42.5(pid=11541): stderr: | [0;m[38;5;43m20221210130540201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130540201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130540201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130540202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130540202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130540202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130540202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:41.907086 run patchelf(pid=11544): Terminating (SIGINT) 13:05:42.075419 run patchelf(pid=11544): Terminated: ok {rc=0} 13:05:42.196698 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11541): Process ended prematurely: osmo-stp_10.42.42.5(pid=11541) [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11541)] [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 13:05:42.206107 tst iperf3.py:8: Test FAILED (7.3 sec) 13:05:42.233387 run osmo-hlr_10.42.42.2(pid=11538): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11538)] 13:05:42.280704 run osmo-hlr_10.42.42.2(pid=11538): stdout: | (launched: 2022-12-10_13:05:39.100708) 13:05:42.329657 run osmo-hlr_10.42.42.2(pid=11538): stderr: | [0;m[1;31m20221210130539276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130539276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130539276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130539276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130539276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130539276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130539291 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130539299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130539299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130539299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:42.379257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11533): Terminating (SIGTERM) 13:05:42.418882 run iperf3-srv_10.42.42.10(pid=11534): Terminating (SIGTERM) 13:05:42.458334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11537): Terminating (SIGTERM) 13:05:42.497837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11540): Terminating (SIGTERM) 13:05:42.537360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11543): Terminating (SIGTERM) 13:05:42.577725 --- ParallelTerminationStrategy: PID 11533 died... 13:05:42.596585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11533): Terminated: ok {rc=0} 13:05:42.640888 --- ParallelTerminationStrategy: PID 11534 died... 13:05:42.659449 run iperf3-srv_10.42.42.10(pid=11534): Terminated {rc=256} 13:05:42.703483 --- ParallelTerminationStrategy: PID 11537 died... 13:05:42.721797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11537): Terminated: ok {rc=0} 13:05:42.765636 --- ParallelTerminationStrategy: PID 11540 died... 13:05:42.784115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11540): Terminated: ok {rc=0} 13:05:42.828016 --- ParallelTerminationStrategy: PID 11543 died... 13:05:42.846604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11543): Terminated: ok {rc=0} 13:05:42.932208 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:05:44.076814 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:44.088282 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:05:44.138294 tst iperf3m4.py: using LAC 28594 13:05:44.259013 tst iperf3m4.py: using RAC 34 13:05:44.378585 tst iperf3m4.py: using CellId 28594 13:05:44.498164 tst iperf3m4.py: using BVCI 28595 13:05:44.607827 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:44.618524 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:44.629077 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:44.639715 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:44.650410 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:44.661076 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:44.672022 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:44.682706 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:05:44.693749 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:05:44.808332 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:05:44.925598 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:05:45.041031 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:05:45.161273 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:05:45.376858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:05:45.696874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11545): Launched 13:05:46.007547 run iperf3-srv_10.42.42.10(pid=11546): Launched 13:05:46.143497 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:05:46.365762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:05:46.695810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11547): Launched 13:05:47.061783 run iperf3-srv_10.42.42.10(pid=11548): Launched 13:05:47.212873 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:05:47.428937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:05:47.749287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11549): Launched 13:05:48.026683 run iperf3-srv_10.42.42.10(pid=11550): Launched 13:05:48.146399 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:05:48.362266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:05:48.682387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11551): Launched 13:05:48.959591 run iperf3-srv_10.42.42.10(pid=11552): Launched 13:05:49.080082 tst iperf3m4.py:8: start network... 13:05:49.295131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:49.791553 run create_hlr_db(pid=11553): Launched 13:05:49.920899 bus /gobi_6: Setting Powered False 13:05:50.983897 run create_hlr_db(pid=11553): Terminated: ok {rc=0} 13:05:51.413278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11555): Launched 13:05:51.713386 run osmo-hlr_10.42.42.2(pid=11556): Launched 13:05:51.828630 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:52.361894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11558): Launched 13:05:52.662014 run osmo-stp_10.42.42.5(pid=11559): Launched 13:05:52.776399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:05:53.308009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11561): Launched 13:05:53.422257 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:05:53.675565 run patchelf(pid=11562): Launched 13:05:53.842344 run osmo-stp_10.42.42.5(pid=11559): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11559)] 13:05:53.969567 run osmo-stp_10.42.42.5(pid=11559): stdout: | (launched: 2022-12-10_13:05:52.607167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:54.098276 run osmo-stp_10.42.42.5(pid=11559): stderr: | [0;m[38;5;43m20221210130552779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130552779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130552780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130552780 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130552781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130552781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130552781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:54.226883 run osmo-stp_10.42.42.5(pid=11559): stdout: | (launched: 2022-12-10_13:05:52.607167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:54.350402 run osmo-stp_10.42.42.5(pid=11559): stderr: | [0;m[38;5;43m20221210130552779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130552779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130552780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130552780 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130552781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130552781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130552781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:54.496675 run patchelf(pid=11562): Terminating (SIGINT) 13:05:54.665946 run patchelf(pid=11562): Terminated: ok {rc=0} 13:05:54.787784 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11559): Process ended prematurely: osmo-stp_10.42.42.5(pid=11559) [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11559)] [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 13:05:54.797142 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:05:54.825188 run osmo-hlr_10.42.42.2(pid=11556): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11556)] 13:05:54.872803 run osmo-hlr_10.42.42.2(pid=11556): stdout: | (launched: 2022-12-10_13:05:51.658490) 13:05:54.921833 run osmo-hlr_10.42.42.2(pid=11556): stderr: | [0;m[1;31m20221210130551835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130551835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130551835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130551835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130551835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130551835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130551847 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130551855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130551856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130551856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:54.971460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11545): Terminating (SIGTERM) 13:05:55.011101 run iperf3-srv_10.42.42.10(pid=11546): Terminating (SIGTERM) 13:05:55.050660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11547): Terminating (SIGTERM) 13:05:55.090307 run iperf3-srv_10.42.42.10(pid=11548): Terminating (SIGTERM) 13:05:55.129817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11549): Terminating (SIGTERM) 13:05:55.169341 run iperf3-srv_10.42.42.10(pid=11550): Terminating (SIGTERM) 13:05:55.209344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11551): Terminating (SIGTERM) 13:05:55.249339 run iperf3-srv_10.42.42.10(pid=11552): Terminating (SIGTERM) 13:05:55.288864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11555): Terminating (SIGTERM) 13:05:55.328245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11558): Terminating (SIGTERM) 13:05:55.367701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11561): Terminating (SIGTERM) 13:05:55.407601 --- ParallelTerminationStrategy: PID 11545 died... 13:05:55.426529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11545): Terminated: ok {rc=0} 13:05:55.470626 --- ParallelTerminationStrategy: PID 11546 died... 13:05:55.488922 run iperf3-srv_10.42.42.10(pid=11546): Terminated {rc=256} 13:05:55.533239 --- ParallelTerminationStrategy: PID 11547 died... 13:05:55.551465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11547): Terminated: ok {rc=0} 13:05:55.595704 --- ParallelTerminationStrategy: PID 11548 died... 13:05:55.614000 run iperf3-srv_10.42.42.10(pid=11548): Terminated {rc=256} 13:05:55.657644 --- ParallelTerminationStrategy: PID 11549 died... 13:05:55.676042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11549): Terminated: ok {rc=0} 13:05:55.719701 --- ParallelTerminationStrategy: PID 11550 died... 13:05:55.738025 run iperf3-srv_10.42.42.10(pid=11550): Terminated {rc=256} 13:05:55.781852 --- ParallelTerminationStrategy: PID 11551 died... 13:05:55.800074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11551): Terminated: ok {rc=0} 13:05:55.844009 --- ParallelTerminationStrategy: PID 11552 died... 13:05:55.862437 run iperf3-srv_10.42.42.10(pid=11552): Terminated {rc=256} 13:05:55.906333 --- ParallelTerminationStrategy: PID 11555 died... 13:05:55.924690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11555): Terminated: ok {rc=0} 13:05:55.968366 --- ParallelTerminationStrategy: PID 11558 died... 13:05:55.986828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11558): Terminated: ok {rc=0} 13:05:56.031928 --- ParallelTerminationStrategy: PID 11561 died... 13:05:56.050575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11561): Terminated: ok {rc=0} 13:05:56.135854 bus /gobi_4: Setting Powered False 13:05:57.235579 bus /gobi_4: Setting Powered False 13:05:58.351474 bus /gobi_1: Setting Powered False 13:05:59.449778 bus /gobi_1: Setting Powered False 13:06:00.564047 bus /gobi_0: Setting Powered False 13:06:01.667137 bus /gobi_0: Setting Powered False 13:06:02.794970 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 13:06:03.897277 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:03.908469 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:06:03.961289 tst ping.py: using LAC 28595 13:06:04.076345 tst ping.py: using RAC 35 13:06:04.190499 tst ping.py: using CellId 28595 13:06:04.305110 tst ping.py: using BVCI 28596 13:06:04.412402 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:04.423144 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:04.433616 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:04.444334 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:04.455086 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:04.465901 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:04.476590 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:04.487322 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:06:04.600643 tst ping.py:19: start network... 13:06:04.797085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:05.252819 run create_hlr_db(pid=11564): Launched 13:06:05.364808 bus /gobi_6: Setting Powered False 13:06:06.424142 run create_hlr_db(pid=11564): Terminated: ok {rc=0} 13:06:06.853537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11566): Launched 13:06:07.168474 run osmo-hlr_10.42.42.2(pid=11567): Launched 13:06:07.288897 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:07.831526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11569): Launched 13:06:08.144479 run osmo-stp_10.42.42.5(pid=11570): Launched 13:06:08.263740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:06:08.805207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11572): Launched 13:06:08.924689 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:06:09.190732 run patchelf(pid=11573): Launched 13:06:09.366112 run osmo-stp_10.42.42.5(pid=11570): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11570)] 13:06:09.499177 run osmo-stp_10.42.42.5(pid=11570): stdout: | (launched: 2022-12-10_13:06:08.087415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:09.633462 run osmo-stp_10.42.42.5(pid=11570): stderr: | [0;m[38;5;43m20221210130608278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130608278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130608279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130608279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130608279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130608279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130608280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:09.767755 run osmo-stp_10.42.42.5(pid=11570): stdout: | (launched: 2022-12-10_13:06:08.087415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:09.897049 run osmo-stp_10.42.42.5(pid=11570): stderr: | [0;m[38;5;43m20221210130608278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130608278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130608279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130608279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130608279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130608279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130608280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:10.050297 run patchelf(pid=11573): Terminating (SIGINT) 13:06:10.227011 run patchelf(pid=11573): Terminated: ok {rc=0} 13:06:10.354193 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11570): Process ended prematurely: osmo-stp_10.42.42.5(pid=11570) [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11570)] [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 13:06:10.363571 tst ping.py:22: Test FAILED (6.5 sec) 13:06:10.391307 run osmo-hlr_10.42.42.2(pid=11567): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11567)] 13:06:10.440751 run osmo-hlr_10.42.42.2(pid=11567): stdout: | (launched: 2022-12-10_13:06:07.110833) 13:06:10.492114 run osmo-hlr_10.42.42.2(pid=11567): stderr: | [0;m[1;31m20221210130607308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130607308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130607308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130607308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130607308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130607308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130607321 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130607329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130607329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130607329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:10.543691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11566): Terminating (SIGTERM) 13:06:10.585236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11569): Terminating (SIGTERM) 13:06:10.626723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11572): Terminating (SIGTERM) 13:06:10.668501 --- ParallelTerminationStrategy: PID 11566 died... 13:06:10.688388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11566): Terminated: ok {rc=0} 13:06:10.734482 --- ParallelTerminationStrategy: PID 11569 died... 13:06:10.754094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11569): Terminated: ok {rc=0} 13:06:10.800097 --- ParallelTerminationStrategy: PID 11572 died... 13:06:10.819683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11572): Terminated: ok {rc=0} 13:06:10.906316 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:06:11.992880 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:12.005197 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:06:12.057850 tst ping_idle_ping.py: using LAC 28596 13:06:12.182978 tst ping_idle_ping.py: using RAC 36 13:06:12.307429 tst ping_idle_ping.py: using CellId 28596 13:06:12.425898 tst ping_idle_ping.py: using BVCI 28597 13:06:12.533469 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:12.544239 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:12.554838 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:12.566074 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:12.576763 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:12.587448 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:12.598423 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:06:12.609766 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:06:12.727452 tst ping_idle_ping.py:24: start network... 13:06:12.925945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:13.385932 run create_hlr_db(pid=11574): Launched 13:06:13.497672 bus /gobi_6: Setting Powered False 13:06:14.557163 run create_hlr_db(pid=11574): Terminated: ok {rc=0} 13:06:14.987798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11576): Launched 13:06:15.302467 run osmo-hlr_10.42.42.2(pid=11577): Launched 13:06:15.422398 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:15.982657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11579): Launched 13:06:16.316002 run osmo-stp_10.42.42.5(pid=11580): Launched 13:06:16.572034 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:06:17.181706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11582): Launched 13:06:17.304349 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:06:17.570238 run patchelf(pid=11583): Launched 13:06:17.744627 run osmo-stp_10.42.42.5(pid=11580): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11580)] 13:06:17.877686 run osmo-stp_10.42.42.5(pid=11580): stdout: | (launched: 2022-12-10_13:06:16.250527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:18.012572 run osmo-stp_10.42.42.5(pid=11580): stderr: | [0;m[38;5;43m20221210130616495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130616495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130616495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130616496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130616496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130616496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130616496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:18.147294 run osmo-stp_10.42.42.5(pid=11580): stdout: | (launched: 2022-12-10_13:06:16.250527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:18.276548 run osmo-stp_10.42.42.5(pid=11580): stderr: | [0;m[38;5;43m20221210130616495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130616495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130616495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130616496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130616496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130616496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130616496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:18.429806 run patchelf(pid=11583): Terminating (SIGINT) 13:06:18.607080 run patchelf(pid=11583): Terminated: ok {rc=0} 13:06:18.734767 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11580): Process ended prematurely: osmo-stp_10.42.42.5(pid=11580) [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11580)] [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 13:06:18.744113 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:06:18.771916 run osmo-hlr_10.42.42.2(pid=11577): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11577)] 13:06:18.821605 run osmo-hlr_10.42.42.2(pid=11577): stdout: | (launched: 2022-12-10_13:06:15.245488) 13:06:18.873130 run osmo-hlr_10.42.42.2(pid=11577): stderr: | [0;m[1;31m20221210130615441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130615441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130615441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130615441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130615441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130615441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130615453 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130615462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130615462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130615462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:18.924854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11576): Terminating (SIGTERM) 13:06:18.966620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11579): Terminating (SIGTERM) 13:06:19.008525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11582): Terminating (SIGTERM) 13:06:19.050726 --- ParallelTerminationStrategy: PID 11576 died... 13:06:19.070729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11576): Terminated: ok {rc=0} 13:06:19.116688 --- ParallelTerminationStrategy: PID 11579 died... 13:06:19.136236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11579): Terminated: ok {rc=0} 13:06:19.182082 --- ParallelTerminationStrategy: PID 11582 died... 13:06:19.201504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11582): Terminated: ok {rc=0} 13:06:19.289616 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:06:20.599462 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:06:20.606277 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:06:20.639856 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:06:20.678816 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:06:20.766305 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:06:20.799393 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:06:20.837893 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:06:21.429852 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:06:21.480440 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:21.491126 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:06:21.563145 tst cs_paging_gprs_active.py: using LAC 28597 13:06:21.685427 tst cs_paging_gprs_active.py: using RAC 37 13:06:21.803437 tst cs_paging_gprs_active.py: using CellId 28597 13:06:21.922748 tst cs_paging_gprs_active.py: using BVCI 28598 13:06:22.036520 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:22.047317 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:22.057903 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:22.068626 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:22.079245 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:22.090127 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:22.100922 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:22.111615 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:22.123176 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:06:22.242409 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:06:22.357899 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:06:22.561115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:06:22.862325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11588): Launched 13:06:23.122773 run iperf3-srv_10.42.42.10(pid=11589): Launched 13:06:23.234905 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:06:23.435423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:06:23.735873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11590): Launched 13:06:23.996687 run iperf3-srv_10.42.42.10(pid=11591): Launched 13:06:24.109377 tst cs_paging_gprs_active.py:38: start network... 13:06:24.309860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:24.774898 run create_hlr_db(pid=11592): Launched 13:06:24.889736 bus /gobi_6: Setting Powered False 13:06:25.949309 run create_hlr_db(pid=11592): Terminated: ok {rc=0} 13:06:26.386902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11594): Launched 13:06:26.706377 run osmo-hlr_10.42.42.2(pid=11595): Launched 13:06:26.828737 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:27.385298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11597): Launched 13:06:27.704419 run osmo-stp_10.42.42.5(pid=11598): Launched 13:06:27.826947 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:06:28.379931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11600): Launched 13:06:28.502330 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:06:28.771573 run patchelf(pid=11601): Launched 13:06:28.949427 run osmo-stp_10.42.42.5(pid=11598): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11598)] 13:06:29.084922 run osmo-stp_10.42.42.5(pid=11598): stdout: | (launched: 2022-12-10_13:06:27.646536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:29.221927 run osmo-stp_10.42.42.5(pid=11598): stderr: | [0;m[38;5;43m20221210130627839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130627839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130627840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130627840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130627840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130627841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130627841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:29.359361 run osmo-stp_10.42.42.5(pid=11598): stdout: | (launched: 2022-12-10_13:06:27.646536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:29.490972 run osmo-stp_10.42.42.5(pid=11598): stderr: | [0;m[38;5;43m20221210130627839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130627839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130627840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130627840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130627840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130627841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130627841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:29.647028 run patchelf(pid=11601): Terminating (SIGINT) 13:06:29.826454 run patchelf(pid=11601): Terminated: ok {rc=0} 13:06:29.956339 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11598): Process ended prematurely: osmo-stp_10.42.42.5(pid=11598) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11598)] [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:06:29.966391 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:06:29.994585 run osmo-hlr_10.42.42.2(pid=11595): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11595)] 13:06:30.044451 run osmo-hlr_10.42.42.2(pid=11595): stdout: | (launched: 2022-12-10_13:06:26.648678) 13:06:30.096047 run osmo-hlr_10.42.42.2(pid=11595): stderr: | [0;m[1;31m20221210130626848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130626849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130626849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130626849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130626849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130626849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130626862 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130626871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130626872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130626872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:30.148235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11588): Terminating (SIGTERM) 13:06:30.189838 run iperf3-srv_10.42.42.10(pid=11589): Terminating (SIGTERM) 13:06:30.231342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11590): Terminating (SIGTERM) 13:06:30.272764 run iperf3-srv_10.42.42.10(pid=11591): Terminating (SIGTERM) 13:06:30.314206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11594): Terminating (SIGTERM) 13:06:30.355748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11597): Terminating (SIGTERM) 13:06:30.397359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11600): Terminating (SIGTERM) 13:06:30.438910 --- ParallelTerminationStrategy: PID 11588 died... 13:06:30.458660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11588): Terminated: ok {rc=0} 13:06:30.504494 --- ParallelTerminationStrategy: PID 11589 died... 13:06:30.523777 run iperf3-srv_10.42.42.10(pid=11589): Terminated {rc=256} 13:06:30.569466 --- ParallelTerminationStrategy: PID 11590 died... 13:06:30.588769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11590): Terminated: ok {rc=0} 13:06:30.634404 --- ParallelTerminationStrategy: PID 11591 died... 13:06:30.653667 run iperf3-srv_10.42.42.10(pid=11591): Terminated {rc=256} 13:06:30.699426 --- ParallelTerminationStrategy: PID 11594 died... 13:06:30.718624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11594): Terminated: ok {rc=0} 13:06:30.763912 --- ParallelTerminationStrategy: PID 11597 died... 13:06:30.783150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11597): Terminated: ok {rc=0} 13:06:30.828532 --- ParallelTerminationStrategy: PID 11600 died... 13:06:30.851188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11600): Terminated: ok {rc=0} 13:06:30.942618 bus /gobi_0: Setting Powered False 13:06:32.038916 bus /gobi_0: Setting Powered False 13:06:33.154633 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:06:34.297504 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:34.308711 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:06:34.379575 tst iperf3.py: using LAC 28598 13:06:34.500432 tst iperf3.py: using RAC 38 13:06:34.627425 tst iperf3.py: using CellId 28598 13:06:34.753161 tst iperf3.py: using BVCI 28599 13:06:34.869570 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:34.880610 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:34.891642 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:34.902708 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:34.913619 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:34.924607 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:34.935652 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:34.946835 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:34.957961 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:06:35.073906 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:06:35.289249 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:06:35.610008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11602): Launched 13:06:35.887133 run iperf3-srv_10.42.42.10(pid=11603): Launched 13:06:36.007389 tst iperf3.py:8: start network... 13:06:36.222992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:36.718368 run create_hlr_db(pid=11604): Launched 13:06:36.847492 bus /gobi_6: Setting Powered False 13:06:37.910586 run create_hlr_db(pid=11604): Terminated: ok {rc=0} 13:06:38.336869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11606): Launched 13:06:38.635459 run osmo-hlr_10.42.42.2(pid=11607): Launched 13:06:38.749735 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:39.276416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11609): Launched 13:06:39.574567 run osmo-stp_10.42.42.5(pid=11610): Launched 13:06:39.689924 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:06:40.206219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11612): Launched 13:06:40.320347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:06:40.573209 run patchelf(pid=11613): Launched 13:06:40.738846 run osmo-stp_10.42.42.5(pid=11610): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11610)] 13:06:40.865118 run osmo-stp_10.42.42.5(pid=11610): stdout: | (launched: 2022-12-10_13:06:39.519864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:40.993204 run osmo-stp_10.42.42.5(pid=11610): stderr: | [0;m[38;5;43m20221210130639690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130639690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130639690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130639691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130639691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130639691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130639691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:41.121815 run osmo-stp_10.42.42.5(pid=11610): stdout: | (launched: 2022-12-10_13:06:39.519864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:41.244316 run osmo-stp_10.42.42.5(pid=11610): stderr: | [0;m[38;5;43m20221210130639690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130639690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130639690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130639691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130639691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130639691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130639691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:41.389849 run patchelf(pid=11613): Terminating (SIGINT) 13:06:41.559126 run patchelf(pid=11613): Terminated: ok {rc=0} 13:06:41.680665 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11610): Process ended prematurely: osmo-stp_10.42.42.5(pid=11610) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11610)] [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 13:06:41.690106 tst iperf3.py:8: Test FAILED (7.4 sec) 13:06:41.717657 run osmo-hlr_10.42.42.2(pid=11607): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11607)] 13:06:41.764907 run osmo-hlr_10.42.42.2(pid=11607): stdout: | (launched: 2022-12-10_13:06:38.580849) 13:06:41.814187 run osmo-hlr_10.42.42.2(pid=11607): stderr: | [0;m[1;31m20221210130638755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130638755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130638755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130638755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130638756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130638756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130638768 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130638778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130638779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130638779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:41.863614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11602): Terminating (SIGTERM) 13:06:41.903064 run iperf3-srv_10.42.42.10(pid=11603): Terminating (SIGTERM) 13:06:41.942574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11606): Terminating (SIGTERM) 13:06:41.981980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11609): Terminating (SIGTERM) 13:06:42.021603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11612): Terminating (SIGTERM) 13:06:42.061596 --- ParallelTerminationStrategy: PID 11602 died... 13:06:42.080460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11602): Terminated: ok {rc=0} 13:06:42.124860 --- ParallelTerminationStrategy: PID 11603 died... 13:06:42.143598 run iperf3-srv_10.42.42.10(pid=11603): Terminated {rc=256} 13:06:42.187950 --- ParallelTerminationStrategy: PID 11606 died... 13:06:42.206340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11606): Terminated: ok {rc=0} 13:06:42.250275 --- ParallelTerminationStrategy: PID 11609 died... 13:06:42.268743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11609): Terminated: ok {rc=0} 13:06:42.312780 --- ParallelTerminationStrategy: PID 11612 died... 13:06:42.331302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11612): Terminated: ok {rc=0} 13:06:42.417550 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:06:43.564268 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:43.575565 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:06:43.643068 tst iperf3m4.py: using LAC 28599 13:06:43.760611 tst iperf3m4.py: using RAC 39 13:06:43.876939 tst iperf3m4.py: using CellId 28599 13:06:43.993384 tst iperf3m4.py: using BVCI 28600 13:06:44.104194 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:44.114895 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:44.125450 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:44.136119 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:44.146884 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:44.157900 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:44.168712 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:44.179368 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:06:44.190183 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:06:44.305470 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:06:44.427304 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:06:44.548387 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:06:44.661832 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:06:44.863637 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:06:45.165191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11614): Launched 13:06:45.426643 run iperf3-srv_10.42.42.10(pid=11615): Launched 13:06:45.539923 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:06:45.741035 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:06:46.061861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11616): Launched 13:06:46.340122 run iperf3-srv_10.42.42.10(pid=11617): Launched 13:06:46.457224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:06:46.664418 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:06:46.982025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11618): Launched 13:06:47.301480 run iperf3-srv_10.42.42.10(pid=11619): Launched 13:06:47.422002 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:06:47.638685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:06:47.960802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11620): Launched 13:06:48.238113 run iperf3-srv_10.42.42.10(pid=11621): Launched 13:06:48.357914 tst iperf3m4.py:8: start network... 13:06:48.573378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:49.069740 run create_hlr_db(pid=11622): Launched 13:06:49.199337 bus /gobi_6: Setting Powered False 13:06:50.262087 run create_hlr_db(pid=11622): Terminated: ok {rc=0} 13:06:50.689135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11624): Launched 13:06:50.988623 run osmo-hlr_10.42.42.2(pid=11625): Launched 13:06:51.103935 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:51.633915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11627): Launched 13:06:51.933786 run osmo-stp_10.42.42.5(pid=11628): Launched 13:06:52.047953 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:06:52.565605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11630): Launched 13:06:52.680047 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:06:52.934610 run patchelf(pid=11631): Launched 13:06:53.101235 run osmo-stp_10.42.42.5(pid=11628): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11628)] 13:06:53.228398 run osmo-stp_10.42.42.5(pid=11628): stdout: | (launched: 2022-12-10_13:06:51.878850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:53.357207 run osmo-stp_10.42.42.5(pid=11628): stderr: | [0;m[38;5;43m20221210130652051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130652051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130652051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130652051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130652052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130652052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130652052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:53.486610 run osmo-stp_10.42.42.5(pid=11628): stdout: | (launched: 2022-12-10_13:06:51.878850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:53.610744 run osmo-stp_10.42.42.5(pid=11628): stderr: | [0;m[38;5;43m20221210130652051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130652051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130652051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130652051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130652052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130652052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130652052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:53.757450 run patchelf(pid=11631): Terminating (SIGINT) 13:06:53.927720 run patchelf(pid=11631): Terminated: ok {rc=0} 13:06:54.049684 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11628): Process ended prematurely: osmo-stp_10.42.42.5(pid=11628) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11628)] [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:06:54.059111 tst iperf3m4.py:8: Test FAILED (10.5 sec) 13:06:54.086565 run osmo-hlr_10.42.42.2(pid=11625): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11625)] 13:06:54.134714 run osmo-hlr_10.42.42.2(pid=11625): stdout: | (launched: 2022-12-10_13:06:50.934098) 13:06:54.183938 run osmo-hlr_10.42.42.2(pid=11625): stderr: | [0;m[1;31m20221210130651111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130651111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130651111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130651111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130651111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130651111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130651126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130651135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130651136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130651136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:54.233662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11614): Terminating (SIGTERM) 13:06:54.273564 run iperf3-srv_10.42.42.10(pid=11615): Terminating (SIGTERM) 13:06:54.313271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11616): Terminating (SIGTERM) 13:06:54.353572 run iperf3-srv_10.42.42.10(pid=11617): Terminating (SIGTERM) 13:06:54.393233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11618): Terminating (SIGTERM) 13:06:54.433159 run iperf3-srv_10.42.42.10(pid=11619): Terminating (SIGTERM) 13:06:54.472763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11620): Terminating (SIGTERM) 13:06:54.512533 run iperf3-srv_10.42.42.10(pid=11621): Terminating (SIGTERM) 13:06:54.552159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11624): Terminating (SIGTERM) 13:06:54.591806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11627): Terminating (SIGTERM) 13:06:54.631465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11630): Terminating (SIGTERM) 13:06:54.671508 --- ParallelTerminationStrategy: PID 11614 died... 13:06:54.690287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11614): Terminated: ok {rc=0} 13:06:54.734224 --- ParallelTerminationStrategy: PID 11615 died... 13:06:54.752635 run iperf3-srv_10.42.42.10(pid=11615): Terminated {rc=256} 13:06:54.796301 --- ParallelTerminationStrategy: PID 11616 died... 13:06:54.814577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11616): Terminated: ok {rc=0} 13:06:54.858139 --- ParallelTerminationStrategy: PID 11617 died... 13:06:54.876309 run iperf3-srv_10.42.42.10(pid=11617): Terminated {rc=256} 13:06:54.919915 --- ParallelTerminationStrategy: PID 11618 died... 13:06:54.938195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11618): Terminated: ok {rc=0} 13:06:54.981501 --- ParallelTerminationStrategy: PID 11619 died... 13:06:54.999717 run iperf3-srv_10.42.42.10(pid=11619): Terminated {rc=256} 13:06:55.043597 --- ParallelTerminationStrategy: PID 11620 died... 13:06:55.061835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11620): Terminated: ok {rc=0} 13:06:55.105673 --- ParallelTerminationStrategy: PID 11621 died... 13:06:55.123914 run iperf3-srv_10.42.42.10(pid=11621): Terminated {rc=256} 13:06:55.166999 --- ParallelTerminationStrategy: PID 11624 died... 13:06:55.185171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11624): Terminated: ok {rc=0} 13:06:55.228205 --- ParallelTerminationStrategy: PID 11627 died... 13:06:55.246527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11627): Terminated: ok {rc=0} 13:06:55.289952 --- ParallelTerminationStrategy: PID 11630 died... 13:06:55.308203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11630): Terminated: ok {rc=0} 13:06:55.393377 bus /gobi_4: Setting Powered False 13:06:56.495410 bus /gobi_4: Setting Powered False 13:06:57.610021 bus /gobi_1: Setting Powered False 13:06:58.707731 bus /gobi_1: Setting Powered False 13:06:59.821348 bus /gobi_0: Setting Powered False 13:07:00.925357 bus /gobi_0: Setting Powered False 13:07:02.052204 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:07:03.153289 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:03.164355 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:07:03.233454 tst ping.py: using LAC 28600 13:07:03.351529 tst ping.py: using RAC 40 13:07:03.469270 tst ping.py: using CellId 28600 13:07:03.585757 tst ping.py: using BVCI 28601 13:07:03.695471 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:03.706326 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:03.716800 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:03.727549 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:03.738246 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:03.749032 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:03.759822 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:03.770518 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:07:03.883824 tst ping.py:19: start network... 13:07:04.080701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:04.537017 run create_hlr_db(pid=11635): Launched 13:07:04.649256 bus /gobi_6: Setting Powered False 13:07:05.708758 run create_hlr_db(pid=11635): Terminated: ok {rc=0} 13:07:06.139240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11637): Launched 13:07:06.451672 run osmo-hlr_10.42.42.2(pid=11638): Launched 13:07:06.572614 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:07.122916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11640): Launched 13:07:07.435708 run osmo-stp_10.42.42.5(pid=11641): Launched 13:07:07.555266 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:08.099388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11643): Launched 13:07:08.219423 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:08.483887 run patchelf(pid=11644): Launched 13:07:08.657982 run osmo-stp_10.42.42.5(pid=11641): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11641)] 13:07:08.791000 run osmo-stp_10.42.42.5(pid=11641): stdout: | (launched: 2022-12-10_13:07:07.378877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:08.925260 run osmo-stp_10.42.42.5(pid=11641): stderr: | [0;m[38;5;43m20221210130707569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130707569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130707569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130707569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130707570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130707570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130707570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:09.060298 run osmo-stp_10.42.42.5(pid=11641): stdout: | (launched: 2022-12-10_13:07:07.378877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:09.189619 run osmo-stp_10.42.42.5(pid=11641): stderr: | [0;m[38;5;43m20221210130707569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130707569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130707569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130707569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130707570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130707570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130707570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:09.342967 run patchelf(pid=11644): Terminating (SIGINT) 13:07:09.519444 run patchelf(pid=11644): Terminated: ok {rc=0} 13:07:09.647024 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11641): Process ended prematurely: osmo-stp_10.42.42.5(pid=11641) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11641)] [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 13:07:09.656363 tst ping.py:22: Test FAILED (6.5 sec) 13:07:09.684140 run osmo-hlr_10.42.42.2(pid=11638): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11638)] 13:07:09.733772 run osmo-hlr_10.42.42.2(pid=11638): stdout: | (launched: 2022-12-10_13:07:06.394590) 13:07:09.785154 run osmo-hlr_10.42.42.2(pid=11638): stderr: | [0;m[1;31m20221210130706591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130706591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130706592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130706592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130706592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130706592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130706604 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130706614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130706614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130706615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:09.836940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11637): Terminating (SIGTERM) 13:07:09.878170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11640): Terminating (SIGTERM) 13:07:09.919314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11643): Terminating (SIGTERM) 13:07:09.961103 --- ParallelTerminationStrategy: PID 11637 died... 13:07:09.980716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11637): Terminated: ok {rc=0} 13:07:10.026638 --- ParallelTerminationStrategy: PID 11640 died... 13:07:10.045877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11640): Terminated: ok {rc=0} 13:07:10.091310 --- ParallelTerminationStrategy: PID 11643 died... 13:07:10.110597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11643): Terminated: ok {rc=0} 13:07:10.197687 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:07:11.283246 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:11.294906 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:07:11.368755 tst ping_idle_ping.py: using LAC 28601 13:07:11.494485 tst ping_idle_ping.py: using RAC 41 13:07:11.619609 tst ping_idle_ping.py: using CellId 28601 13:07:11.747863 tst ping_idle_ping.py: using BVCI 28602 13:07:11.863317 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:11.874625 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:11.885700 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:11.896707 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:11.907735 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:11.919068 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:11.930192 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:07:11.941134 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:07:12.055329 tst ping_idle_ping.py:24: start network... 13:07:12.253937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:12.718525 run create_hlr_db(pid=11645): Launched 13:07:12.831961 bus /gobi_6: Setting Powered False 13:07:13.890717 run create_hlr_db(pid=11645): Terminated: ok {rc=0} 13:07:14.303026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11647): Launched 13:07:14.597691 run osmo-hlr_10.42.42.2(pid=11648): Launched 13:07:14.710261 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:15.217702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11650): Launched 13:07:15.513532 run osmo-stp_10.42.42.5(pid=11651): Launched 13:07:15.626834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:16.178180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11653): Launched 13:07:16.308015 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:16.590436 run patchelf(pid=11654): Launched 13:07:16.773021 run osmo-stp_10.42.42.5(pid=11651): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11651)] 13:07:16.910790 run osmo-stp_10.42.42.5(pid=11651): stdout: | (launched: 2022-12-10_13:07:15.459471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:17.050326 run osmo-stp_10.42.42.5(pid=11651): stderr: | [0;m[38;5;43m20221210130715628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130715628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130715629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130715629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130715630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130715630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130715630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:17.188201 run osmo-stp_10.42.42.5(pid=11651): stdout: | (launched: 2022-12-10_13:07:15.459471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:17.318358 run osmo-stp_10.42.42.5(pid=11651): stderr: | [0;m[38;5;43m20221210130715628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130715628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130715629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130715629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130715630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130715630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130715630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:17.471932 run patchelf(pid=11654): Terminating (SIGINT) 13:07:17.649370 run patchelf(pid=11654): Terminated: ok {rc=0} 13:07:17.777426 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11651): Process ended prematurely: osmo-stp_10.42.42.5(pid=11651) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11651)] [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:07:17.786821 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:07:17.814865 run osmo-hlr_10.42.42.2(pid=11648): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11648)] 13:07:17.865297 run osmo-hlr_10.42.42.2(pid=11648): stdout: | (launched: 2022-12-10_13:07:14.543736) 13:07:17.917426 run osmo-hlr_10.42.42.2(pid=11648): stderr: | [0;m[1;31m20221210130714719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130714719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130714719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130714719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130714719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130714719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130714731 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130714739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130714739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130714739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:17.970513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11647): Terminating (SIGTERM) 13:07:18.012579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11650): Terminating (SIGTERM) 13:07:18.054572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11653): Terminating (SIGTERM) 13:07:18.096714 --- ParallelTerminationStrategy: PID 11647 died... 13:07:18.116848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11647): Terminated: ok {rc=0} 13:07:18.163113 --- ParallelTerminationStrategy: PID 11650 died... 13:07:18.182747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11650): Terminated: ok {rc=0} 13:07:18.228805 --- ParallelTerminationStrategy: PID 11653 died... 13:07:18.248594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11653): Terminated: ok {rc=0} 13:07:18.335077 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:07:19.639952 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:07:19.646918 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:07:19.681429 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:07:19.720182 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:07:19.806041 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:07:19.839121 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:07:19.877406 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:07:20.473817 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:07:20.526209 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:20.537612 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:07:20.607708 tst cs_paging_gprs_active.py: using LAC 28602 13:07:20.733533 tst cs_paging_gprs_active.py: using RAC 42 13:07:20.856500 tst cs_paging_gprs_active.py: using CellId 28602 13:07:20.987948 tst cs_paging_gprs_active.py: using BVCI 28603 13:07:21.106305 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:21.117635 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:21.128682 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:21.139858 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:21.150814 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:21.161808 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:21.172750 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:21.183644 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:21.194769 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:07:21.310556 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:07:21.425403 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:07:21.628167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:21.931523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11658): Launched 13:07:22.194165 run iperf3-srv_10.42.42.10(pid=11659): Launched 13:07:22.306975 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:07:22.508650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:22.810787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11660): Launched 13:07:23.073103 run iperf3-srv_10.42.42.10(pid=11661): Launched 13:07:23.185866 tst cs_paging_gprs_active.py:38: start network... 13:07:23.387487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:23.852888 run create_hlr_db(pid=11662): Launched 13:07:23.968010 bus /gobi_6: Setting Powered False 13:07:25.027108 run create_hlr_db(pid=11662): Terminated: ok {rc=0} 13:07:25.462845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11664): Launched 13:07:25.782270 run osmo-hlr_10.42.42.2(pid=11665): Launched 13:07:25.904170 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:26.452823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11667): Launched 13:07:26.771796 run osmo-stp_10.42.42.5(pid=11668): Launched 13:07:26.893611 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:27.446062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11670): Launched 13:07:27.568280 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:27.839403 run patchelf(pid=11671): Launched 13:07:28.017283 run osmo-stp_10.42.42.5(pid=11668): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11668)] 13:07:28.152442 run osmo-stp_10.42.42.5(pid=11668): stdout: | (launched: 2022-12-10_13:07:26.714041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:28.289270 run osmo-stp_10.42.42.5(pid=11668): stderr: | [0;m[38;5;43m20221210130726907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130726908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130726908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130726908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130726909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130726909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130726909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:28.426228 run osmo-stp_10.42.42.5(pid=11668): stdout: | (launched: 2022-12-10_13:07:26.714041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:28.557669 run osmo-stp_10.42.42.5(pid=11668): stderr: | [0;m[38;5;43m20221210130726907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130726908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130726908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130726908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130726909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130726909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130726909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:28.713676 run patchelf(pid=11671): Terminating (SIGINT) 13:07:28.893092 run patchelf(pid=11671): Terminated: ok {rc=0} 13:07:29.022924 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11668): Process ended prematurely: osmo-stp_10.42.42.5(pid=11668) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11668)] [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:07:29.032934 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:07:29.061117 run osmo-hlr_10.42.42.2(pid=11665): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11665)] 13:07:29.110635 run osmo-hlr_10.42.42.2(pid=11665): stdout: | (launched: 2022-12-10_13:07:25.724041) 13:07:29.161825 run osmo-hlr_10.42.42.2(pid=11665): stderr: | [0;m[1;31m20221210130725921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130725921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130725921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130725921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130725921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130725921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130725933 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130725941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130725942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130725942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:29.213670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11658): Terminating (SIGTERM) 13:07:29.255077 run iperf3-srv_10.42.42.10(pid=11659): Terminating (SIGTERM) 13:07:29.296392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11660): Terminating (SIGTERM) 13:07:29.337922 run iperf3-srv_10.42.42.10(pid=11661): Terminating (SIGTERM) 13:07:29.379282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11664): Terminating (SIGTERM) 13:07:29.420656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11667): Terminating (SIGTERM) 13:07:29.461842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11670): Terminating (SIGTERM) 13:07:29.503344 --- ParallelTerminationStrategy: PID 11658 died... 13:07:29.522992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11658): Terminated: ok {rc=0} 13:07:29.568614 --- ParallelTerminationStrategy: PID 11659 died... 13:07:29.587954 run iperf3-srv_10.42.42.10(pid=11659): Terminated {rc=256} 13:07:29.634076 --- ParallelTerminationStrategy: PID 11660 died... 13:07:29.653465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11660): Terminated: ok {rc=0} 13:07:29.699255 --- ParallelTerminationStrategy: PID 11661 died... 13:07:29.718512 run iperf3-srv_10.42.42.10(pid=11661): Terminated {rc=256} 13:07:29.764075 --- ParallelTerminationStrategy: PID 11664 died... 13:07:29.783810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11664): Terminated: ok {rc=0} 13:07:29.830455 --- ParallelTerminationStrategy: PID 11667 died... 13:07:29.849928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11667): Terminated: ok {rc=0} 13:07:29.895637 --- ParallelTerminationStrategy: PID 11670 died... 13:07:29.915161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11670): Terminated: ok {rc=0} 13:07:30.002701 bus /gobi_0: Setting Powered False 13:07:31.105044 bus /gobi_0: Setting Powered False 13:07:32.220110 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:07:33.364132 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:33.375897 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:07:33.452033 tst iperf3.py: using LAC 28603 13:07:33.570760 tst iperf3.py: using RAC 43 13:07:33.688537 tst iperf3.py: using CellId 28603 13:07:33.808383 tst iperf3.py: using BVCI 28604 13:07:33.925151 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:33.936449 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:33.947666 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:33.958943 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:33.970335 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:33.981889 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:33.992794 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:34.003725 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:34.014806 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:07:34.133485 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:07:34.348913 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:34.669171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11672): Launched 13:07:34.946016 run iperf3-srv_10.42.42.10(pid=11673): Launched 13:07:35.066230 tst iperf3.py:8: start network... 13:07:35.281997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:35.777044 run create_hlr_db(pid=11674): Launched 13:07:35.906128 bus /gobi_6: Setting Powered False 13:07:36.966380 run create_hlr_db(pid=11674): Terminated: ok {rc=0} 13:07:37.411203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11676): Launched 13:07:37.730047 run osmo-hlr_10.42.42.2(pid=11677): Launched 13:07:37.851214 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:38.405213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11679): Launched 13:07:38.723221 run osmo-stp_10.42.42.5(pid=11680): Launched 13:07:38.844433 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:39.396506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11682): Launched 13:07:39.518040 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:39.786538 run patchelf(pid=11683): Launched 13:07:39.964462 run osmo-stp_10.42.42.5(pid=11680): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11680)] 13:07:40.099722 run osmo-stp_10.42.42.5(pid=11680): stdout: | (launched: 2022-12-10_13:07:38.665057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:40.236131 run osmo-stp_10.42.42.5(pid=11680): stderr: | [0;m[38;5;43m20221210130738856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130738856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130738857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130738857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130738857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130738858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130738858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:40.372370 run osmo-stp_10.42.42.5(pid=11680): stdout: | (launched: 2022-12-10_13:07:38.665057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:40.503091 run osmo-stp_10.42.42.5(pid=11680): stderr: | [0;m[38;5;43m20221210130738856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130738856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130738857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130738857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130738857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130738858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130738858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:40.658449 run patchelf(pid=11683): Terminating (SIGINT) 13:07:40.837995 run patchelf(pid=11683): Terminated: ok {rc=0} 13:07:40.967101 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11680): Process ended prematurely: osmo-stp_10.42.42.5(pid=11680) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11680)] [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 13:07:40.977502 tst iperf3.py:8: Test FAILED (7.6 sec) 13:07:41.005847 run osmo-hlr_10.42.42.2(pid=11677): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11677)] 13:07:41.056128 run osmo-hlr_10.42.42.2(pid=11677): stdout: | (launched: 2022-12-10_13:07:37.672413) 13:07:41.107931 run osmo-hlr_10.42.42.2(pid=11677): stderr: | [0;m[1;31m20221210130737872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130737872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130737872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130737872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130737872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130737872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130737885 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130737893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130737893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130737893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:41.160013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11672): Terminating (SIGTERM) 13:07:41.201849 run iperf3-srv_10.42.42.10(pid=11673): Terminating (SIGTERM) 13:07:41.243696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11676): Terminating (SIGTERM) 13:07:41.286087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11679): Terminating (SIGTERM) 13:07:41.327817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11682): Terminating (SIGTERM) 13:07:41.369869 --- ParallelTerminationStrategy: PID 11672 died... 13:07:41.389666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11672): Terminated: ok {rc=0} 13:07:41.435645 --- ParallelTerminationStrategy: PID 11673 died... 13:07:41.454980 run iperf3-srv_10.42.42.10(pid=11673): Terminated {rc=256} 13:07:41.500586 --- ParallelTerminationStrategy: PID 11676 died... 13:07:41.519892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11676): Terminated: ok {rc=0} 13:07:41.565367 --- ParallelTerminationStrategy: PID 11679 died... 13:07:41.584638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11679): Terminated: ok {rc=0} 13:07:41.630170 --- ParallelTerminationStrategy: PID 11682 died... 13:07:41.649510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11682): Terminated: ok {rc=0} 13:07:41.736381 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:07:42.889484 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:42.901478 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:07:42.971860 tst iperf3m4.py: using LAC 28604 13:07:43.097397 tst iperf3m4.py: using RAC 44 13:07:43.222704 tst iperf3m4.py: using CellId 28604 13:07:43.353368 tst iperf3m4.py: using BVCI 28605 13:07:43.464825 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:43.475854 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:43.486620 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:43.497588 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:43.508383 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:43.519293 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:43.530432 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:43.541098 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:07:43.551934 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:07:43.670674 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:07:43.787325 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:07:43.905663 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:07:44.026915 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:07:44.243568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:44.564122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11684): Launched 13:07:44.841720 run iperf3-srv_10.42.42.10(pid=11685): Launched 13:07:44.962184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:07:45.180177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:45.501896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11686): Launched 13:07:45.778777 run iperf3-srv_10.42.42.10(pid=11687): Launched 13:07:45.911037 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:07:46.133042 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:46.471189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11688): Launched 13:07:46.762472 run iperf3-srv_10.42.42.10(pid=11689): Launched 13:07:46.889897 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:07:47.111921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:47.436467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11690): Launched 13:07:47.713342 run iperf3-srv_10.42.42.10(pid=11691): Launched 13:07:47.832693 tst iperf3m4.py:8: start network... 13:07:48.048681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:48.544311 run create_hlr_db(pid=11692): Launched 13:07:48.673500 bus /gobi_6: Setting Powered False 13:07:49.737107 run create_hlr_db(pid=11692): Terminated: ok {rc=0} 13:07:50.182072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11694): Launched 13:07:50.501175 run osmo-hlr_10.42.42.2(pid=11695): Launched 13:07:50.623406 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:51.173935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11697): Launched 13:07:51.491103 run osmo-stp_10.42.42.5(pid=11698): Launched 13:07:51.612729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:52.165774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11700): Launched 13:07:52.287556 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:52.558384 run patchelf(pid=11701): Launched 13:07:52.735388 run osmo-stp_10.42.42.5(pid=11698): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11698)] 13:07:52.870295 run osmo-stp_10.42.42.5(pid=11698): stdout: | (launched: 2022-12-10_13:07:51.433298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:53.007855 run osmo-stp_10.42.42.5(pid=11698): stderr: | [0;m[38;5;43m20221210130751625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130751625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130751626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130751626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130751626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130751626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130751627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:53.144891 run osmo-stp_10.42.42.5(pid=11698): stdout: | (launched: 2022-12-10_13:07:51.433298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:53.276281 run osmo-stp_10.42.42.5(pid=11698): stderr: | [0;m[38;5;43m20221210130751625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130751625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130751626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130751626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130751626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130751626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130751627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:53.431758 run patchelf(pid=11701): Terminating (SIGINT) 13:07:53.610825 run patchelf(pid=11701): Terminated: ok {rc=0} 13:07:53.739903 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11698): Process ended prematurely: osmo-stp_10.42.42.5(pid=11698) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11698)] [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:07:53.749958 tst iperf3m4.py:8: Test FAILED (10.9 sec) 13:07:53.778563 run osmo-hlr_10.42.42.2(pid=11695): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11695)] 13:07:53.828533 run osmo-hlr_10.42.42.2(pid=11695): stdout: | (launched: 2022-12-10_13:07:50.442974) 13:07:53.880147 run osmo-hlr_10.42.42.2(pid=11695): stderr: | [0;m[1;31m20221210130750642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130750642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130750642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130750642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130750642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130750642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130750655 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130750664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130750664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130750664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:53.931903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11684): Terminating (SIGTERM) 13:07:53.974107 run iperf3-srv_10.42.42.10(pid=11685): Terminating (SIGTERM) 13:07:54.015902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11686): Terminating (SIGTERM) 13:07:54.057327 run iperf3-srv_10.42.42.10(pid=11687): Terminating (SIGTERM) 13:07:54.098495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11688): Terminating (SIGTERM) 13:07:54.139625 run iperf3-srv_10.42.42.10(pid=11689): Terminating (SIGTERM) 13:07:54.180585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11690): Terminating (SIGTERM) 13:07:54.221809 run iperf3-srv_10.42.42.10(pid=11691): Terminating (SIGTERM) 13:07:54.262818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11694): Terminating (SIGTERM) 13:07:54.304399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11697): Terminating (SIGTERM) 13:07:54.345716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11700): Terminating (SIGTERM) 13:07:54.387084 --- ParallelTerminationStrategy: PID 11684 died... 13:07:54.406411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11684): Terminated: ok {rc=0} 13:07:54.451942 --- ParallelTerminationStrategy: PID 11685 died... 13:07:54.471167 run iperf3-srv_10.42.42.10(pid=11685): Terminated {rc=256} 13:07:54.516314 --- ParallelTerminationStrategy: PID 11686 died... 13:07:54.535593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11686): Terminated: ok {rc=0} 13:07:54.581289 --- ParallelTerminationStrategy: PID 11687 died... 13:07:54.600257 run iperf3-srv_10.42.42.10(pid=11687): Terminated {rc=256} 13:07:54.645503 --- ParallelTerminationStrategy: PID 11688 died... 13:07:54.664780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11688): Terminated: ok {rc=0} 13:07:54.710062 --- ParallelTerminationStrategy: PID 11689 died... 13:07:54.729322 run iperf3-srv_10.42.42.10(pid=11689): Terminated {rc=256} 13:07:54.774652 --- ParallelTerminationStrategy: PID 11690 died... 13:07:54.793945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11690): Terminated: ok {rc=0} 13:07:54.839520 --- ParallelTerminationStrategy: PID 11691 died... 13:07:54.858810 run iperf3-srv_10.42.42.10(pid=11691): Terminated {rc=256} 13:07:54.904682 --- ParallelTerminationStrategy: PID 11694 died... 13:07:54.923948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11694): Terminated: ok {rc=0} 13:07:54.969493 --- ParallelTerminationStrategy: PID 11697 died... 13:07:54.989173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11697): Terminated: ok {rc=0} 13:07:55.034933 --- ParallelTerminationStrategy: PID 11700 died... 13:07:55.054290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11700): Terminated: ok {rc=0} 13:07:55.141042 bus /gobi_4: Setting Powered False 13:07:56.239244 bus /gobi_4: Setting Powered False 13:07:57.357670 bus /gobi_1: Setting Powered False 13:07:58.456033 bus /gobi_1: Setting Powered False 13:07:59.571726 bus /gobi_0: Setting Powered False 13:08:00.669519 bus /gobi_0: Setting Powered False 13:08:01.795836 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:08:02.921548 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:02.933363 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:08:03.005117 tst ping.py: using LAC 28605 13:08:03.129483 tst ping.py: using RAC 45 13:08:03.253149 tst ping.py: using CellId 28605 13:08:03.377941 tst ping.py: using BVCI 28606 13:08:03.494271 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:03.505622 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:03.516689 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:03.527841 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:03.538853 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:03.549950 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:03.561243 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:03.572217 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:08:03.690062 tst ping.py:19: start network... 13:08:03.901329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:04.387495 run create_hlr_db(pid=11702): Launched 13:08:04.514085 bus /gobi_6: Setting Powered False 13:08:05.576168 run create_hlr_db(pid=11702): Terminated: ok {rc=0} 13:08:05.996106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11704): Launched 13:08:06.293236 run osmo-hlr_10.42.42.2(pid=11705): Launched 13:08:06.405516 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:06.919108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11707): Launched 13:08:07.212771 run osmo-stp_10.42.42.5(pid=11708): Launched 13:08:07.324243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:07.832084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11710): Launched 13:08:07.944298 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:08.193134 run patchelf(pid=11711): Launched 13:08:08.356719 run osmo-stp_10.42.42.5(pid=11708): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11708)] 13:08:08.481385 run osmo-stp_10.42.42.5(pid=11708): stdout: | (launched: 2022-12-10_13:08:07.159284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:08.607112 run osmo-stp_10.42.42.5(pid=11708): stderr: | [0;m[38;5;43m20221210130807329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130807329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130807329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130807330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130807330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130807330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130807330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:08.732866 run osmo-stp_10.42.42.5(pid=11708): stdout: | (launched: 2022-12-10_13:08:07.159284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:08.853978 run osmo-stp_10.42.42.5(pid=11708): stderr: | [0;m[38;5;43m20221210130807329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130807329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130807329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130807330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130807330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130807330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130807330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:08.996530 run patchelf(pid=11711): Terminating (SIGINT) 13:08:09.162397 run patchelf(pid=11711): Terminated: ok {rc=0} 13:08:09.281456 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11708): Process ended prematurely: osmo-stp_10.42.42.5(pid=11708) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11708)] [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 13:08:09.290360 tst ping.py:22: Test FAILED (6.4 sec) 13:08:09.316879 run osmo-hlr_10.42.42.2(pid=11705): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11705)] 13:08:09.363934 run osmo-hlr_10.42.42.2(pid=11705): stdout: | (launched: 2022-12-10_13:08:06.239081) 13:08:09.412466 run osmo-hlr_10.42.42.2(pid=11705): stderr: | [0;m[1;31m20221210130806415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130806415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130806415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130806415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130806415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130806415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130806430 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130806440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130806440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130806440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:09.461512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11704): Terminating (SIGTERM) 13:08:09.500848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11707): Terminating (SIGTERM) 13:08:09.540162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11710): Terminating (SIGTERM) 13:08:09.579724 --- ParallelTerminationStrategy: PID 11704 died... 13:08:09.598442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11704): Terminated: ok {rc=0} 13:08:09.642142 --- ParallelTerminationStrategy: PID 11707 died... 13:08:09.660751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11707): Terminated: ok {rc=0} 13:08:09.704292 --- ParallelTerminationStrategy: PID 11710 died... 13:08:09.722618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11710): Terminated: ok {rc=0} 13:08:09.804341 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:08:10.888799 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:10.900755 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:08:10.972128 tst ping_idle_ping.py: using LAC 28606 13:08:11.091829 tst ping_idle_ping.py: using RAC 46 13:08:11.211663 tst ping_idle_ping.py: using CellId 28606 13:08:11.326653 tst ping_idle_ping.py: using BVCI 28607 13:08:11.434206 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:11.444934 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:11.455644 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:11.466465 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:11.477136 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:11.488219 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:11.499105 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:08:11.509793 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:08:11.625788 tst ping_idle_ping.py:24: start network... 13:08:11.837428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:12.327211 run create_hlr_db(pid=11712): Launched 13:08:12.456351 bus /gobi_6: Setting Powered False 13:08:13.518734 run create_hlr_db(pid=11712): Terminated: ok {rc=0} 13:08:13.939740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11714): Launched 13:08:14.235789 run osmo-hlr_10.42.42.2(pid=11715): Launched 13:08:14.348414 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:14.868868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11717): Launched 13:08:15.163232 run osmo-stp_10.42.42.5(pid=11718): Launched 13:08:15.275621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:15.783389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11720): Launched 13:08:15.925544 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:16.185747 run patchelf(pid=11721): Launched 13:08:16.376840 run osmo-stp_10.42.42.5(pid=11718): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11718)] 13:08:16.523023 run osmo-stp_10.42.42.5(pid=11718): stdout: | (launched: 2022-12-10_13:08:15.109258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:16.705356 run osmo-stp_10.42.42.5(pid=11718): stderr: | [0;m[38;5;43m20221210130815279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130815279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130815279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130815280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130815280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130815280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130815280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:16.871520 run osmo-stp_10.42.42.5(pid=11718): stdout: | (launched: 2022-12-10_13:08:15.109258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:17.009234 run osmo-stp_10.42.42.5(pid=11718): stderr: | [0;m[38;5;43m20221210130815279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130815279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130815279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130815280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130815280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130815280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130815280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:17.167213 run patchelf(pid=11721): Terminating (SIGINT) 13:08:17.349375 run patchelf(pid=11721): Terminated: ok {rc=0} 13:08:17.502900 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11718): Process ended prematurely: osmo-stp_10.42.42.5(pid=11718) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11718)] [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:08:17.513464 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:08:17.547520 run osmo-hlr_10.42.42.2(pid=11715): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11715)] 13:08:17.607464 run osmo-hlr_10.42.42.2(pid=11715): stdout: | (launched: 2022-12-10_13:08:14.182115) 13:08:17.670093 run osmo-hlr_10.42.42.2(pid=11715): stderr: | [0;m[1;31m20221210130814359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130814359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130814359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130814359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130814359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130814359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130814382 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130814392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130814392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130814392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:17.724134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11714): Terminating (SIGTERM) 13:08:17.768053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11717): Terminating (SIGTERM) 13:08:17.814969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11720): Terminating (SIGTERM) 13:08:17.868261 --- ParallelTerminationStrategy: PID 11714 died... 13:08:17.890094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11714): Terminated: ok {rc=0} 13:08:17.944243 --- ParallelTerminationStrategy: PID 11717 died... 13:08:17.965103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11717): Terminated: ok {rc=0} 13:08:18.020550 --- ParallelTerminationStrategy: PID 11720 died... 13:08:18.047137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11720): Terminated: ok {rc=0} 13:08:18.149530 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:08:19.456800 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:08:19.463367 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:08:19.499162 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 13:08:19.539226 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 13:08:19.624419 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:08:19.660505 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 13:08:19.700670 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 13:08:20.297152 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 13:08:20.349893 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:20.362086 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:08:20.414684 tst cs_paging_gprs_active.py: using LAC 28607 13:08:20.536926 tst cs_paging_gprs_active.py: using RAC 47 13:08:20.657876 tst cs_paging_gprs_active.py: using CellId 28607 13:08:20.783281 tst cs_paging_gprs_active.py: using BVCI 28608 13:08:20.899315 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:20.911975 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:20.925036 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:20.938018 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:20.949830 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:20.962830 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:20.976630 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:20.990328 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:21.003660 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:08:21.124732 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:08:21.241684 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:08:21.450463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:21.777985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11997): Launched 13:08:22.065132 run iperf3-srv_10.42.42.10(pid=11998): Launched 13:08:22.194290 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:08:22.400605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:22.719595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11999): Launched 13:08:23.005416 run iperf3-srv_10.42.42.10(pid=12000): Launched 13:08:23.130755 tst cs_paging_gprs_active.py:38: start network... 13:08:23.336117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:23.827913 run create_hlr_db(pid=12001): Launched 13:08:23.985247 bus /gobi_6: Setting Powered False 13:08:25.048695 run create_hlr_db(pid=12001): Terminated: ok {rc=0} 13:08:25.498025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12003): Launched 13:08:25.825694 run osmo-hlr_10.42.42.2(pid=12004): Launched 13:08:26.059815 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:26.801723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12006): Launched 13:08:27.133713 run osmo-stp_10.42.42.5(pid=12007): Launched 13:08:27.373529 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:28.017979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12009): Launched 13:08:28.152809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:28.434386 run patchelf(pid=12010): Launched 13:08:28.628032 run osmo-stp_10.42.42.5(pid=12007): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12007)] 13:08:28.766482 run osmo-stp_10.42.42.5(pid=12007): stdout: | (launched: 2022-12-10_13:08:27.063338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:28.906602 run osmo-stp_10.42.42.5(pid=12007): stderr: | [0;m[38;5;43m20221210130827359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130827359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130827359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130827360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130827360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130827360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130827360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:29.047766 run osmo-stp_10.42.42.5(pid=12007): stdout: | (launched: 2022-12-10_13:08:27.063338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:29.182504 run osmo-stp_10.42.42.5(pid=12007): stderr: | [0;m[38;5;43m20221210130827359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130827359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130827359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130827360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130827360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130827360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130827360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:29.342036 run patchelf(pid=12010): Terminating (SIGINT) 13:08:29.525306 run patchelf(pid=12010): Terminated: ok {rc=0} 13:08:29.657990 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12007): Process ended prematurely: osmo-stp_10.42.42.5(pid=12007) [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12007)] [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 13:08:29.669270 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 13:08:29.699486 run osmo-hlr_10.42.42.2(pid=12004): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12004)] 13:08:29.751689 run osmo-hlr_10.42.42.2(pid=12004): stdout: | (launched: 2022-12-10_13:08:25.755079) 13:08:29.805070 run osmo-hlr_10.42.42.2(pid=12004): stderr: | [0;m[1;31m20221210130826103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130826103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130826103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130826103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130826103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130826103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130826123 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130826132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130826132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130826132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:29.858820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11997): Terminating (SIGTERM) 13:08:29.902253 run iperf3-srv_10.42.42.10(pid=11998): Terminating (SIGTERM) 13:08:29.945545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11999): Terminating (SIGTERM) 13:08:29.988920 run iperf3-srv_10.42.42.10(pid=12000): Terminating (SIGTERM) 13:08:30.033348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12003): Terminating (SIGTERM) 13:08:30.077638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12006): Terminating (SIGTERM) 13:08:30.121467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12009): Terminating (SIGTERM) 13:08:30.165598 --- ParallelTerminationStrategy: PID 11997 died... 13:08:30.186430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11997): Terminated: ok {rc=0} 13:08:30.235734 --- ParallelTerminationStrategy: PID 11998 died... 13:08:30.256691 run iperf3-srv_10.42.42.10(pid=11998): Terminated {rc=256} 13:08:30.304172 --- ParallelTerminationStrategy: PID 11999 died... 13:08:30.324842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11999): Terminated: ok {rc=0} 13:08:30.372066 --- ParallelTerminationStrategy: PID 12000 died... 13:08:30.392232 run iperf3-srv_10.42.42.10(pid=12000): Terminated {rc=256} 13:08:30.439363 --- ParallelTerminationStrategy: PID 12003 died... 13:08:30.459606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12003): Terminated: ok {rc=0} 13:08:30.506808 --- ParallelTerminationStrategy: PID 12006 died... 13:08:30.527118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12006): Terminated: ok {rc=0} 13:08:30.574471 --- ParallelTerminationStrategy: PID 12009 died... 13:08:30.594882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12009): Terminated: ok {rc=0} 13:08:30.685250 bus /gobi_0: Setting Powered False 13:08:31.818242 bus /gobi_0: Setting Powered False 13:08:32.961445 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 13:08:34.118826 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:34.132150 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:08:34.199735 tst iperf3.py: using LAC 28608 13:08:34.338028 tst iperf3.py: using RAC 48 13:08:34.469535 tst iperf3.py: using CellId 28608 13:08:34.600437 tst iperf3.py: using BVCI 28609 13:08:34.722786 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:34.735670 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:34.748298 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:34.760687 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:34.773317 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:34.786024 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:34.799753 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:34.812050 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:34.825087 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:08:34.949084 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:08:35.174369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:35.521697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12011): Launched 13:08:35.825730 run iperf3-srv_10.42.42.10(pid=12012): Launched 13:08:35.959825 tst iperf3.py:8: start network... 13:08:36.186563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:36.711334 run create_hlr_db(pid=12013): Launched 13:08:36.878672 bus /gobi_6: Setting Powered False 13:08:37.943799 run create_hlr_db(pid=12013): Terminated: ok {rc=0} 13:08:38.417726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12015): Launched 13:08:38.757515 run osmo-hlr_10.42.42.2(pid=12016): Launched 13:08:38.873622 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:39.404260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12019): Launched 13:08:39.702972 run osmo-stp_10.42.42.5(pid=12020): Launched 13:08:39.817694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:40.335712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12022): Launched 13:08:40.451833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:40.704919 run patchelf(pid=12023): Launched 13:08:40.871976 run osmo-stp_10.42.42.5(pid=12020): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12020)] 13:08:40.998829 run osmo-stp_10.42.42.5(pid=12020): stdout: | (launched: 2022-12-10_13:08:39.648317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:41.127520 run osmo-stp_10.42.42.5(pid=12020): stderr: | [0;m[38;5;43m20221210130839817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130839817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130839818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130839818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130839820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130839820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130839820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:41.256199 run osmo-stp_10.42.42.5(pid=12020): stdout: | (launched: 2022-12-10_13:08:39.648317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:41.379337 run osmo-stp_10.42.42.5(pid=12020): stderr: | [0;m[38;5;43m20221210130839817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130839817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130839818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130839818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130839820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130839820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130839820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:41.525457 run patchelf(pid=12023): Terminating (SIGINT) 13:08:41.694158 run patchelf(pid=12023): Terminated: ok {rc=0} 13:08:41.815796 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12020): Process ended prematurely: osmo-stp_10.42.42.5(pid=12020) [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12020)] [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 13:08:41.825276 tst iperf3.py:8: Test FAILED (7.7 sec) 13:08:41.852234 run osmo-hlr_10.42.42.2(pid=12016): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12016)] 13:08:41.900109 run osmo-hlr_10.42.42.2(pid=12016): stdout: | (launched: 2022-12-10_13:08:38.697245) 13:08:41.949139 run osmo-hlr_10.42.42.2(pid=12016): stderr: | [0;m[1;31m20221210130838879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130838879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130838879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130838879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130838879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130838879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130838891 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130838900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130838900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130838900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:41.998531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12011): Terminating (SIGTERM) 13:08:42.038152 run iperf3-srv_10.42.42.10(pid=12012): Terminating (SIGTERM) 13:08:42.077454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12015): Terminating (SIGTERM) 13:08:42.117190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12019): Terminating (SIGTERM) 13:08:42.156860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12022): Terminating (SIGTERM) 13:08:42.196538 --- ParallelTerminationStrategy: PID 12011 died... 13:08:42.215420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12011): Terminated: ok {rc=0} 13:08:42.259350 --- ParallelTerminationStrategy: PID 12012 died... 13:08:42.277724 run iperf3-srv_10.42.42.10(pid=12012): Terminated {rc=256} 13:08:42.321175 --- ParallelTerminationStrategy: PID 12015 died... 13:08:42.339392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12015): Terminated: ok {rc=0} 13:08:42.383196 --- ParallelTerminationStrategy: PID 12019 died... 13:08:42.401580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12019): Terminated: ok {rc=0} 13:08:42.445061 --- ParallelTerminationStrategy: PID 12022 died... 13:08:42.463473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12022): Terminated: ok {rc=0} 13:08:42.548481 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 13:08:43.693853 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:43.705708 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:08:43.759321 tst iperf3m4.py: using LAC 28609 13:08:43.878619 tst iperf3m4.py: using RAC 49 13:08:43.997549 tst iperf3m4.py: using CellId 28609 13:08:44.124501 tst iperf3m4.py: using BVCI 28610 13:08:44.242838 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:44.254427 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:44.265807 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:44.277285 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:44.288605 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:44.299985 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:44.311448 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:44.322752 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:08:44.334313 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:08:44.450795 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:08:44.573363 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:08:44.689395 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:08:44.803835 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:08:45.006221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:45.307234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12024): Launched 13:08:45.568858 run iperf3-srv_10.42.42.10(pid=12025): Launched 13:08:45.682151 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:08:45.900839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:46.217694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12026): Launched 13:08:46.507285 run iperf3-srv_10.42.42.10(pid=12027): Launched 13:08:46.633538 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:08:46.839554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:47.161405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12028): Launched 13:08:47.425825 run iperf3-srv_10.42.42.10(pid=12029): Launched 13:08:47.539088 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:08:47.741034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:48.043686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12030): Launched 13:08:48.304674 run iperf3-srv_10.42.42.10(pid=12031): Launched 13:08:48.417480 tst iperf3m4.py:8: start network... 13:08:48.618513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:49.082548 run create_hlr_db(pid=12032): Launched 13:08:49.197884 bus /gobi_6: Setting Powered False 13:08:50.257901 run create_hlr_db(pid=12032): Terminated: ok {rc=0} 13:08:50.675000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12034): Launched 13:08:50.974529 run osmo-hlr_10.42.42.2(pid=12035): Launched 13:08:51.089393 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:51.611060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12037): Launched 13:08:51.909609 run osmo-stp_10.42.42.5(pid=12038): Launched 13:08:52.025221 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:52.544071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12040): Launched 13:08:52.658729 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:52.912374 run patchelf(pid=12041): Launched 13:08:53.079354 run osmo-stp_10.42.42.5(pid=12038): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12038)] 13:08:53.206319 run osmo-stp_10.42.42.5(pid=12038): stdout: | (launched: 2022-12-10_13:08:51.855136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:53.334882 run osmo-stp_10.42.42.5(pid=12038): stderr: | [0;m[38;5;43m20221210130852025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130852026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130852026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130852026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130852027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130852027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130852027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:53.463750 run osmo-stp_10.42.42.5(pid=12038): stdout: | (launched: 2022-12-10_13:08:51.855136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:53.587092 run osmo-stp_10.42.42.5(pid=12038): stderr: | [0;m[38;5;43m20221210130852025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130852026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130852026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130852026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130852027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130852027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130852027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:53.733222 run patchelf(pid=12041): Terminating (SIGINT) 13:08:53.902142 run patchelf(pid=12041): Terminated: ok {rc=0} 13:08:54.024544 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12038): Process ended prematurely: osmo-stp_10.42.42.5(pid=12038) [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12038)] [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 13:08:54.034399 tst iperf3m4.py:8: Test FAILED (10.4 sec) 13:08:54.062380 run osmo-hlr_10.42.42.2(pid=12035): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12035)] 13:08:54.110253 run osmo-hlr_10.42.42.2(pid=12035): stdout: | (launched: 2022-12-10_13:08:50.919288) 13:08:54.159431 run osmo-hlr_10.42.42.2(pid=12035): stderr: | [0;m[1;31m20221210130851095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130851095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130851095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130851095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130851095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130851095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130851108 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130851116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130851116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130851116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:54.209494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12024): Terminating (SIGTERM) 13:08:54.249214 run iperf3-srv_10.42.42.10(pid=12025): Terminating (SIGTERM) 13:08:54.288522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12026): Terminating (SIGTERM) 13:08:54.328136 run iperf3-srv_10.42.42.10(pid=12027): Terminating (SIGTERM) 13:08:54.367582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12028): Terminating (SIGTERM) 13:08:54.407054 run iperf3-srv_10.42.42.10(pid=12029): Terminating (SIGTERM) 13:08:54.446723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12030): Terminating (SIGTERM) 13:08:54.486295 run iperf3-srv_10.42.42.10(pid=12031): Terminating (SIGTERM) 13:08:54.525720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12034): Terminating (SIGTERM) 13:08:54.565422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12037): Terminating (SIGTERM) 13:08:54.604917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12040): Terminating (SIGTERM) 13:08:54.644731 --- ParallelTerminationStrategy: PID 12024 died... 13:08:54.663606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12024): Terminated: ok {rc=0} 13:08:54.707868 --- ParallelTerminationStrategy: PID 12025 died... 13:08:54.726286 run iperf3-srv_10.42.42.10(pid=12025): Terminated {rc=256} 13:08:54.770062 --- ParallelTerminationStrategy: PID 12026 died... 13:08:54.788355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12026): Terminated: ok {rc=0} 13:08:54.832881 --- ParallelTerminationStrategy: PID 12027 died... 13:08:54.851309 run iperf3-srv_10.42.42.10(pid=12027): Terminated {rc=256} 13:08:54.895654 --- ParallelTerminationStrategy: PID 12028 died... 13:08:54.914183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12028): Terminated: ok {rc=0} 13:08:54.957916 --- ParallelTerminationStrategy: PID 12029 died... 13:08:54.976275 run iperf3-srv_10.42.42.10(pid=12029): Terminated {rc=256} 13:08:55.020157 --- ParallelTerminationStrategy: PID 12030 died... 13:08:55.038663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12030): Terminated: ok {rc=0} 13:08:55.083140 --- ParallelTerminationStrategy: PID 12031 died... 13:08:55.101641 run iperf3-srv_10.42.42.10(pid=12031): Terminated {rc=256} 13:08:55.145545 --- ParallelTerminationStrategy: PID 12034 died... 13:08:55.163989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12034): Terminated: ok {rc=0} 13:08:55.207892 --- ParallelTerminationStrategy: PID 12037 died... 13:08:55.226378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12037): Terminated: ok {rc=0} 13:08:55.270218 --- ParallelTerminationStrategy: PID 12040 died... 13:08:55.288574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12040): Terminated: ok {rc=0} 13:08:55.374066 bus /gobi_4: Setting Powered False 13:08:56.472506 bus /gobi_4: Setting Powered False 13:08:57.587527 bus /gobi_1: Setting Powered False 13:08:58.684208 bus /gobi_1: Setting Powered False 13:08:59.798815 bus /gobi_0: Setting Powered False 13:09:00.907300 bus /gobi_0: Setting Powered False 13:09:02.028574 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 13:09:03.137374 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:03.149232 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:09:03.202428 tst ping.py: using LAC 28610 13:09:03.320148 tst ping.py: using RAC 50 13:09:03.436478 tst ping.py: using CellId 28610 13:09:03.553566 tst ping.py: using BVCI 28611 13:09:03.669888 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:03.681723 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:03.693281 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:03.705370 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:03.717413 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:03.729455 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:03.741598 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:03.753652 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:09:03.870907 tst ping.py:19: start network... 13:09:04.069114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:04.525301 run create_hlr_db(pid=12043): Launched 13:09:04.639134 bus /gobi_6: Setting Powered False 13:09:05.697923 run create_hlr_db(pid=12043): Terminated: ok {rc=0} 13:09:06.109210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12045): Launched 13:09:06.402922 run osmo-hlr_10.42.42.2(pid=12046): Launched 13:09:06.515010 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:07.022403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12048): Launched 13:09:07.315985 run osmo-stp_10.42.42.5(pid=12049): Launched 13:09:07.429173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:07.936840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12051): Launched 13:09:08.050233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:08.300209 run patchelf(pid=12052): Launched 13:09:08.464889 run osmo-stp_10.42.42.5(pid=12049): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12049)] 13:09:08.590446 run osmo-stp_10.42.42.5(pid=12049): stdout: | (launched: 2022-12-10_13:09:07.262291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:08.716844 run osmo-stp_10.42.42.5(pid=12049): stderr: | [0;m[38;5;43m20221210130907431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130907431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130907432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130907432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130907433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130907433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130907433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:08.843704 run osmo-stp_10.42.42.5(pid=12049): stdout: | (launched: 2022-12-10_13:09:07.262291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:08.965261 run osmo-stp_10.42.42.5(pid=12049): stderr: | [0;m[38;5;43m20221210130907431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130907431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130907432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130907432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130907433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130907433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130907433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:09.109218 run patchelf(pid=12052): Terminating (SIGINT) 13:09:09.276015 run patchelf(pid=12052): Terminated: ok {rc=0} 13:09:09.395958 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12049): Process ended prematurely: osmo-stp_10.42.42.5(pid=12049) [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12049)] [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 13:09:09.404758 tst ping.py:22: Test FAILED (6.3 sec) 13:09:09.431729 run osmo-hlr_10.42.42.2(pid=12046): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12046)] 13:09:09.479151 run osmo-hlr_10.42.42.2(pid=12046): stdout: | (launched: 2022-12-10_13:09:06.349186) 13:09:09.528210 run osmo-hlr_10.42.42.2(pid=12046): stderr: | [0;m[1;31m20221210130906526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130906526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130906526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130906526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130906526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130906526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130906538 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130906547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130906547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130906547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:09.577858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12045): Terminating (SIGTERM) 13:09:09.617513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12048): Terminating (SIGTERM) 13:09:09.657246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12051): Terminating (SIGTERM) 13:09:09.697713 --- ParallelTerminationStrategy: PID 12045 died... 13:09:09.716504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12045): Terminated: ok {rc=0} 13:09:09.760573 --- ParallelTerminationStrategy: PID 12048 died... 13:09:09.779066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12048): Terminated: ok {rc=0} 13:09:09.822732 --- ParallelTerminationStrategy: PID 12051 died... 13:09:09.840895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12051): Terminated: ok {rc=0} 13:09:09.925639 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 13:09:11.012466 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:11.024292 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:09:11.077126 tst ping_idle_ping.py: using LAC 28611 13:09:11.195837 tst ping_idle_ping.py: using RAC 51 13:09:11.313360 tst ping_idle_ping.py: using CellId 28611 13:09:11.431051 tst ping_idle_ping.py: using BVCI 28612 13:09:11.540011 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:11.551159 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:11.562072 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:11.573365 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:11.584460 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:11.595644 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:11.606794 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:09:11.618174 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:09:11.737486 tst ping_idle_ping.py:24: start network... 13:09:11.950583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:12.440673 run create_hlr_db(pid=12053): Launched 13:09:12.569061 bus /gobi_6: Setting Powered False 13:09:13.631474 run create_hlr_db(pid=12053): Terminated: ok {rc=0} 13:09:14.070366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12055): Launched 13:09:14.384045 run osmo-hlr_10.42.42.2(pid=12056): Launched 13:09:14.503735 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:15.047954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12058): Launched 13:09:15.362448 run osmo-stp_10.42.42.5(pid=12059): Launched 13:09:15.482300 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:16.041816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12061): Launched 13:09:16.166459 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:16.453738 run patchelf(pid=12062): Launched 13:09:16.632196 run osmo-stp_10.42.42.5(pid=12059): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12059)] 13:09:16.769106 run osmo-stp_10.42.42.5(pid=12059): stdout: | (launched: 2022-12-10_13:09:15.305318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:16.907881 run osmo-stp_10.42.42.5(pid=12059): stderr: | [0;m[38;5;43m20221210130915495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130915495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130915495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130915496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130915496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130915496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130915496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:17.062296 run osmo-stp_10.42.42.5(pid=12059): stdout: | (launched: 2022-12-10_13:09:15.305318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:17.188116 run osmo-stp_10.42.42.5(pid=12059): stderr: | [0;m[38;5;43m20221210130915495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130915495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130915495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130915496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130915496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130915496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130915496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:17.335761 run patchelf(pid=12062): Terminating (SIGINT) 13:09:17.503006 run patchelf(pid=12062): Terminated: ok {rc=0} 13:09:17.623491 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12059): Process ended prematurely: osmo-stp_10.42.42.5(pid=12059) [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12059)] [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 13:09:17.632458 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:09:17.659290 run osmo-hlr_10.42.42.2(pid=12056): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12056)] 13:09:17.706698 run osmo-hlr_10.42.42.2(pid=12056): stdout: | (launched: 2022-12-10_13:09:14.327012) 13:09:17.755476 run osmo-hlr_10.42.42.2(pid=12056): stderr: | [0;m[1;31m20221210130914525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130914525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130914525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130914525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130914525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130914525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130914539 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130914549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130914549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130914549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:17.805170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12055): Terminating (SIGTERM) 13:09:17.844682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12058): Terminating (SIGTERM) 13:09:17.884274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12061): Terminating (SIGTERM) 13:09:17.923948 --- ParallelTerminationStrategy: PID 12055 died... 13:09:17.942922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12055): Terminated: ok {rc=0} 13:09:17.986568 --- ParallelTerminationStrategy: PID 12058 died... 13:09:18.005721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12058): Terminated: ok {rc=0} 13:09:18.049461 --- ParallelTerminationStrategy: PID 12061 died... 13:09:18.067815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12061): Terminated: ok {rc=0} 13:09:18.152339 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:09:19.456943 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:09:19.463864 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:09:19.497266 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:09:19.532252 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:09:19.587013 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:09:19.621883 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:09:19.657216 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:09:20.210821 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:09:20.216233 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:09:20.227878 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:09:20.300473 tst switch_tch_pdch.py: using LAC 28612 13:09:20.425079 tst switch_tch_pdch.py: using RAC 52 13:09:20.548684 tst switch_tch_pdch.py: using CellId 28612 13:09:20.671692 tst switch_tch_pdch.py: using BVCI 28613 13:09:20.785486 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:09:20.796874 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:09:20.808190 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:09:20.819484 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:09:20.830896 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:09:20.842184 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:09:20.853566 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:09:20.865036 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:09:20.981749 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:09:21.096262 tst switch_tch_pdch.py:51: start network... 13:09:21.293378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:21.748109 run create_hlr_db(pid=12067): Launched 13:09:21.861463 bus /gobi_6: Setting Powered False 13:09:22.920736 run create_hlr_db(pid=12067): Terminated: ok {rc=0} 13:09:23.331160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12069): Launched 13:09:23.625492 run osmo-hlr_10.42.42.2(pid=12070): Launched 13:09:23.738808 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:24.258865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12072): Launched 13:09:24.552550 run osmo-stp_10.42.42.5(pid=12073): Launched 13:09:24.665472 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:25.173673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12075): Launched 13:09:25.286717 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:25.536148 run patchelf(pid=12076): Launched 13:09:25.700037 run osmo-stp_10.42.42.5(pid=12073): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12073)] 13:09:25.825158 run osmo-stp_10.42.42.5(pid=12073): stdout: | (launched: 2022-12-10_13:09:24.498554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:25.950898 run osmo-stp_10.42.42.5(pid=12073): stderr: | [0;m[38;5;43m20221210130924668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130924668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130924668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130924669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130924669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130924669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130924669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:26.076747 run osmo-stp_10.42.42.5(pid=12073): stdout: | (launched: 2022-12-10_13:09:24.498554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:26.197670 run osmo-stp_10.42.42.5(pid=12073): stderr: | [0;m[38;5;43m20221210130924668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130924668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130924668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130924669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130924669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130924669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130924669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:26.340467 run patchelf(pid=12076): Terminating (SIGINT) 13:09:26.506320 run patchelf(pid=12076): Terminated: ok {rc=0} 13:09:26.625567 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12073): Process ended prematurely: osmo-stp_10.42.42.5(pid=12073) [trial-2375↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12073)] [trial-2375↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:09:26.634410 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:09:26.660869 run osmo-hlr_10.42.42.2(pid=12070): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12070)] 13:09:26.708552 run osmo-hlr_10.42.42.2(pid=12070): stdout: | (launched: 2022-12-10_13:09:23.571652) 13:09:26.757397 run osmo-hlr_10.42.42.2(pid=12070): stderr: | [0;m[1;31m20221210130923747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130923747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130923747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130923747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130923747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130923747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130923759 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130923767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130923767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130923767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:26.806533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12069): Terminating (SIGTERM) 13:09:26.845841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12072): Terminating (SIGTERM) 13:09:26.885151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12075): Terminating (SIGTERM) 13:09:26.924702 --- ParallelTerminationStrategy: PID 12069 died... 13:09:26.943478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12069): Terminated: ok {rc=0} 13:09:26.987290 --- ParallelTerminationStrategy: PID 12072 died... 13:09:27.005631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12072): Terminated: ok {rc=0} 13:09:27.049343 --- ParallelTerminationStrategy: PID 12075 died... 13:09:27.067689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12075): Terminated: ok {rc=0} 13:09:27.150715 bus /gobi_0: Setting Powered False 13:09:28.247131 bus /gobi_0: Setting Powered False 13:09:29.361819 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:09:30.614834 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:09:30.621207 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:09:30.654866 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:09:30.689431 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:09:30.741233 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:09:30.774193 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:09:30.808092 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:09:31.362242 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:09:31.371103 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:09:31.386102 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:09:31.469735 tst switch_tch_pdch.py: using LAC 28613 13:09:31.611521 tst switch_tch_pdch.py: using RAC 53 13:09:31.752893 tst switch_tch_pdch.py: using CellId 28613 13:09:31.870312 tst switch_tch_pdch.py: using BVCI 28614 13:09:31.984252 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:09:31.996037 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:09:32.009097 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:09:32.020707 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:09:32.033413 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:09:32.046200 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:09:32.060240 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:09:32.073830 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:09:32.193396 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:09:32.310482 tst switch_tch_pdch.py:51: start network... 13:09:32.509467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:32.941876 run create_hlr_db(pid=12080): Launched 13:09:33.055174 bus /gobi_6: Setting Powered False 13:09:34.114747 run create_hlr_db(pid=12080): Terminated: ok {rc=0} 13:09:34.517142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12082): Launched 13:09:34.831755 run osmo-hlr_10.42.42.2(pid=12083): Launched 13:09:34.950922 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:35.463443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12085): Launched 13:09:35.761394 run osmo-stp_10.42.42.5(pid=12086): Launched 13:09:35.873086 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:36.366882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12088): Launched 13:09:36.479014 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:36.726770 run patchelf(pid=12089): Launched 13:09:36.890283 run osmo-stp_10.42.42.5(pid=12086): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12086)] 13:09:37.014508 run osmo-stp_10.42.42.5(pid=12086): stdout: | (launched: 2022-12-10_13:09:35.707520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:37.140227 run osmo-stp_10.42.42.5(pid=12086): stderr: | [0;m[38;5;43m20221210130935876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130935876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130935876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130935877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130935879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130935879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130935879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:37.266113 run osmo-stp_10.42.42.5(pid=12086): stdout: | (launched: 2022-12-10_13:09:35.707520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:37.386775 run osmo-stp_10.42.42.5(pid=12086): stderr: | [0;m[38;5;43m20221210130935876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130935876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130935876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130935877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130935879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130935879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130935879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:37.529747 run patchelf(pid=12089): Terminating (SIGINT) 13:09:37.694805 run patchelf(pid=12089): Terminated: ok {rc=0} 13:09:37.814580 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12086): Process ended prematurely: osmo-stp_10.42.42.5(pid=12086) [trial-2375↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12086)] [trial-2375↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:09:37.823444 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:09:37.850008 run osmo-hlr_10.42.42.2(pid=12083): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12083)] 13:09:37.896930 run osmo-hlr_10.42.42.2(pid=12083): stdout: | (launched: 2022-12-10_13:09:34.774580) 13:09:37.945610 run osmo-hlr_10.42.42.2(pid=12083): stderr: | [0;m[1;31m20221210130934976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130934976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130934976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130934976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130934976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130934976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130934991 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130935001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130935001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130935001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:37.994731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12082): Terminating (SIGTERM) 13:09:38.033860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12085): Terminating (SIGTERM) 13:09:38.072842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12088): Terminating (SIGTERM) 13:09:38.112161 --- ParallelTerminationStrategy: PID 12082 died... 13:09:38.130814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12082): Terminated: ok {rc=0} 13:09:38.174222 --- ParallelTerminationStrategy: PID 12085 died... 13:09:38.192217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12085): Terminated: ok {rc=0} 13:09:38.235995 --- ParallelTerminationStrategy: PID 12088 died... 13:09:38.254130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12088): Terminated: ok {rc=0} 13:09:38.335319 bus /gobi_0: Setting Powered False 13:09:39.432006 bus /gobi_0: Setting Powered False 13:09:40.548550 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 13:09:41.798088 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:09:41.802817 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:09:41.837185 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 13:09:41.843978 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 13:09:41.895337 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:09:41.929136 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 13:09:41.935912 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 13:09:42.475371 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 13:09:42.480376 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 13:09:42.491500 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:09:42.539801 tst mo_mt_sms.py: using LAC 28614 13:09:42.657636 tst mo_mt_sms.py: using RAC 54 13:09:42.782350 tst mo_mt_sms.py: using CellId 28614 13:09:42.905684 tst mo_mt_sms.py: using BVCI 28615 13:09:43.019239 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:09:43.132700 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:09:43.248187 tst mo_mt_sms.py:9: start nitb and bts... 13:09:43.461305 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:09:44.098319 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12093): Launched 13:09:44.410463 run osmo-nitb_10.42.42.2(pid=12094): Launched 13:09:44.583405 run osmo-nitb_10.42.42.2(pid=12094): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12094)] 13:09:44.723718 run osmo-nitb_10.42.42.2(pid=12094): stdout: | (launched: 2022-12-10_13:09:44.353805) 13:09:44.864749 run osmo-nitb_10.42.42.2(pid=12094): stderr: | (launched: 2022-12-10_13:09:44.400445) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:09:45.006397 run osmo-nitb_10.42.42.2(pid=12094): stdout: | (launched: 2022-12-10_13:09:44.353805) 13:09:45.142895 run osmo-nitb_10.42.42.2(pid=12094): stderr: | (launched: 2022-12-10_13:09:44.400445) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12094) [trial-2375↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12094)] 13:09:45.528176 tst osmo-nitb_10.42.42.2(pid=12094): stdout: | (launched: 2022-12-10_13:09:44.353805) 13:09:45.654488 tst osmo-nitb_10.42.42.2(pid=12094): stderr: | (launched: 2022-12-10_13:09:44.400445) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:09:45.802982 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12094) [trial-2375↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12094)] [trial-2375↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 13:09:45.811864 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 13:09:45.819021 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12093): Terminating (SIGTERM) 13:09:46.053669 --- ParallelTerminationStrategy: PID 12093 died... 13:09:46.073504 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12093): Terminated: ok {rc=0} 13:09:46.176732 bus /sierra_3: Setting Powered False 13:09:47.284913 bus /sierra_3: Setting Powered False 13:09:48.400639 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 sms:trx-sysmocell5000 --------------------------------------------------------------------- 13:09:49.595720 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:09:49.599790 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:09:49.633550 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:09:49.660033 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 13:09:49.710104 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:09:49.742911 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:09:49.769093 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 13:09:50.315668 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 13:09:50.320817 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:09:50.331578 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:09:50.379043 tst mo_mt_sms.py: using LAC 28615 13:09:50.497177 tst mo_mt_sms.py: using RAC 55 13:09:50.612603 tst mo_mt_sms.py: using CellId 28615 13:09:50.728937 tst mo_mt_sms.py: using BVCI 28616 13:09:50.843545 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:09:50.854693 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:09:50.866737 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:09:50.877733 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:09:50.888707 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:09:50.899706 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:09:51.013267 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:09:51.130402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:51.618284 run create_hlr_db(pid=12098): Launched 13:09:51.746524 bus /sierra_2: Setting Powered False 13:09:52.808479 run create_hlr_db(pid=12098): Terminated: ok {rc=0} 13:09:53.230710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12100): Launched 13:09:53.524895 run osmo-hlr_10.42.42.2(pid=12101): Launched 13:09:53.637370 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:54.153180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12103): Launched 13:09:54.446943 run osmo-stp_10.42.42.5(pid=12104): Launched 13:09:54.559632 run osmo-msc_10.42.42.6: Starting osmo-msc 13:09:55.092753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12106): Launched 13:09:55.387383 run osmo-msc_10.42.42.6(pid=12107): Launched 13:09:55.552613 run osmo-stp_10.42.42.5(pid=12104): ERR: Terminated: ERROR {rc=1} [trial-2375↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12104)] 13:09:55.677658 run osmo-stp_10.42.42.5(pid=12104): stdout: | (launched: 2022-12-10_13:09:54.393146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:55.802835 run osmo-stp_10.42.42.5(pid=12104): stderr: | [0;m[38;5;43m20221210130954563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130954564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130954564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130954564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130954565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130954565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130954565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:55.925815 run osmo-stp_10.42.42.5(pid=12104): stdout: | (launched: 2022-12-10_13:09:54.393146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:56.042675 run osmo-stp_10.42.42.5(pid=12104): stderr: | [0;m[38;5;43m20221210130954563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210130954564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210130954564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210130954564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210130954565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210130954565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210130954565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:56.183321 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12104): Process ended prematurely: osmo-stp_10.42.42.5(pid=12104) [trial-2375↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12104)] [trial-2375↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 13:09:56.191633 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 13:09:56.217486 run osmo-hlr_10.42.42.2(pid=12101): ERR: Terminated: ERROR {rc=237} [trial-2375↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12101)] 13:09:56.265223 run osmo-hlr_10.42.42.2(pid=12101): stdout: | (launched: 2022-12-10_13:09:53.471121) 13:09:56.313973 run osmo-hlr_10.42.42.2(pid=12101): stderr: | [0;m[1;31m20221210130953644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210130953644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210130953644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210130953644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210130953644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210130953644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210130953656 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210130953667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210130953667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210130953667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:56.382170 run osmo-msc_10.42.42.6(pid=12107): ERR: Terminated: ERROR {rc=2} [trial-2375↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12107)] 13:09:56.429261 run osmo-msc_10.42.42.6(pid=12107): stdout: | (launched: 2022-12-10_13:09:55.333539) 13:09:56.477817 run osmo-msc_10.42.42.6(pid=12107): stderr: | [0;m[38;5;43m20221210130955603 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210130955603 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e4b38ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210130955603 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210130955603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210130955603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210130955603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210130955606 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210130955606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210130955606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210130955606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:09:56.527054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12100): Terminating (SIGTERM) 13:09:56.566301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12103): Terminating (SIGTERM) 13:09:56.605541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12106): Terminating (SIGTERM) 13:09:56.645098 --- ParallelTerminationStrategy: PID 12100 died... 13:09:56.663727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12100): Terminated: ok {rc=0} 13:09:56.707649 --- ParallelTerminationStrategy: PID 12103 died... 13:09:56.726031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12103): Terminated: ok {rc=0} 13:09:56.769297 --- ParallelTerminationStrategy: PID 12106 died... 13:09:56.787459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12106): Terminated: ok {rc=0} 13:09:56.870629 bus /sierra_3: Setting Powered False 13:09:57.966929 bus /sierra_3: Setting Powered False 13:09:59.081259 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 13:10:00.306349 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:10:00.311077 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:10:00.345374 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 13:10:00.352124 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 13:10:00.389926 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:10:00.424404 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 13:10:00.431303 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 13:10:00.953412 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2375 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 13:10:00.958996 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 13:10:00.974915 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:10:01.031319 tst assert_extension.py: using LAC 28616 13:10:01.159310 tst assert_extension.py: using RAC 56 13:10:01.290075 tst assert_extension.py: using CellId 28616 13:10:01.451524 tst assert_extension.py: using BVCI 28617 13:10:01.574355 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 13:10:01.694141 tst assert_extension.py:10: start nitb and bts... 13:10:01.910370 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:10:02.526806 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12115): Launched 13:10:02.821516 run osmo-nitb_10.42.42.2(pid=12116): Launched 13:10:02.984873 run osmo-nitb_10.42.42.2(pid=12116): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12116)] 13:10:03.118544 run osmo-nitb_10.42.42.2(pid=12116): stdout: | (launched: 2022-12-10_13:10:02.767631) 13:10:03.252429 run osmo-nitb_10.42.42.2(pid=12116): stderr: | (launched: 2022-12-10_13:10:02.811640) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:10:03.386591 run osmo-nitb_10.42.42.2(pid=12116): stdout: | (launched: 2022-12-10_13:10:02.767631) 13:10:03.515241 run osmo-nitb_10.42.42.2(pid=12116): stderr: | (launched: 2022-12-10_13:10:02.811640) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12116): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12116) [trial-2375↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12116)] 13:10:03.933262 tst osmo-nitb_10.42.42.2(pid=12116): stdout: | (launched: 2022-12-10_13:10:02.767631) 13:10:04.051810 tst osmo-nitb_10.42.42.2(pid=12116): stderr: | (launched: 2022-12-10_13:10:02.811640) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:10:04.192287 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12116): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12116) [trial-2375↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12116)] [trial-2375↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 13:10:04.200733 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:10:04.207477 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12115): Terminating (SIGTERM) 13:10:04.416316 --- ParallelTerminationStrategy: PID 12115 died... 13:10:04.436700 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12115): Terminated: ok {rc=0} 13:10:04.523369 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 13:10:05.701754 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:10:05.706003 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:10:05.739982 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:10:05.766412 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 13:10:05.800248 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:10:05.833689 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:10:05.860232 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 13:10:06.391457 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2375 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 13:10:06.396578 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:10:06.407289 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:10:06.455141 tst assert_extension.py: using LAC 28617 13:10:06.572818 tst assert_extension.py: using RAC 57 13:10:06.688855 tst assert_extension.py: using CellId 28617 13:10:06.812487 tst assert_extension.py: using BVCI 28618 13:10:06.925746 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:10:06.936862 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:10:06.947861 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:10:06.958865 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:10:06.969892 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:10:06.980870 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 13:10:07.093720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:07.548749 run create_hlr_db(pid=12120): Launched 13:10:07.662818 bus /sierra_2: Setting Powered False 13:10:08.721270 run create_hlr_db(pid=12120): Terminated: ok {rc=0} 13:10:09.153124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12122): Launched 13:10:09.467227 run osmo-hlr_10.42.42.2(pid=12123): Launched 13:10:09.588322 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:10.217447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12125): Launched 13:10:10.526619 run osmo-stp_10.42.42.5(pid=12126): Launched 13:10:10.644605 run osmo-msc_10.42.42.6: Starting osmo-msc 13:10:11.203395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12128): Launched 13:10:11.511169 run osmo-msc_10.42.42.6(pid=12129): Launched 13:10:11.683952 run osmo-stp_10.42.42.5(pid=12126): ERR: Terminated: ERROR {rc=1} [trial-2375↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12126)] 13:10:11.814935 run osmo-stp_10.42.42.5(pid=12126): stdout: | (launched: 2022-12-10_13:10:10.470555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:11.946856 run osmo-stp_10.42.42.5(pid=12126): stderr: | [0;m[38;5;43m20221210131010660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131010661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131010661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131010661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131010662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131010662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131010662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:12.078340 run osmo-stp_10.42.42.5(pid=12126): stdout: | (launched: 2022-12-10_13:10:10.470555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:12.201504 run osmo-stp_10.42.42.5(pid=12126): stderr: | [0;m[38;5;43m20221210131010660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131010661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131010661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131010661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131010662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131010662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131010662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:12.348707 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12126): Process ended prematurely: osmo-stp_10.42.42.5(pid=12126) [trial-2375↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12126)] [trial-2375↪ussd:trx-sysmocell5000↪assert_extension.py:17] 13:10:12.357693 tst assert_extension.py:17: Test FAILED (6.0 sec) 13:10:12.384753 run osmo-hlr_10.42.42.2(pid=12123): ERR: Terminated: ERROR {rc=237} [trial-2375↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12123)] 13:10:12.434520 run osmo-hlr_10.42.42.2(pid=12123): stdout: | (launched: 2022-12-10_13:10:09.409876) 13:10:12.485830 run osmo-hlr_10.42.42.2(pid=12123): stderr: | [0;m[1;31m20221210131009608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131009608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131009608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131009608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131009608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131009608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131009624 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131009634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131009634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131009634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:12.557315 run osmo-msc_10.42.42.6(pid=12129): ERR: Terminated: ERROR {rc=2} [trial-2375↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12129)] 13:10:12.606490 run osmo-msc_10.42.42.6(pid=12129): stdout: | (launched: 2022-12-10_13:10:11.454965) 13:10:12.657282 run osmo-msc_10.42.42.6(pid=12129): stderr: | [0;m[38;5;43m20221210131011774 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131011774 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe701862c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131011774 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131011774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131011774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131011775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131011776 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131011777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131011777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131011777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:10:12.708582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12122): Terminating (SIGTERM) 13:10:12.749785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12125): Terminating (SIGTERM) 13:10:12.790964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12128): Terminating (SIGTERM) 13:10:12.832400 --- ParallelTerminationStrategy: PID 12122 died... 13:10:12.852180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12122): Terminated: ok {rc=0} 13:10:12.897934 --- ParallelTerminationStrategy: PID 12125 died... 13:10:12.917036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12125): Terminated: ok {rc=0} 13:10:12.962461 --- ParallelTerminationStrategy: PID 12128 died... 13:10:12.981677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12128): Terminated: ok {rc=0} 13:10:13.067594 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:10:14.282483 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:10:14.289407 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:10:14.323278 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:10:14.350035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:10:14.402261 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:10:14.437239 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:10:14.463876 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:10:15.015038 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:10:15.066183 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:10:15.077678 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:10:15.147871 tst mo_mt_call.py: using LAC 28618 13:10:15.272350 tst mo_mt_call.py: using RAC 58 13:10:15.397807 tst mo_mt_call.py: using CellId 28618 13:10:15.522731 tst mo_mt_call.py: using BVCI 28619 13:10:15.637107 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:10:15.648560 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:10:15.659863 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:10:15.671159 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:10:15.682489 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:10:15.693824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:10:15.807950 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:10:15.943202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:16.449854 run create_hlr_db(pid=12134): Launched 13:10:16.608363 bus /sierra_2: Setting Powered False 13:10:17.667527 run create_hlr_db(pid=12134): Terminated: ok {rc=0} 13:10:18.109955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12136): Launched 13:10:18.424524 run osmo-hlr_10.42.42.2(pid=12137): Launched 13:10:18.544788 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:19.088573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12139): Launched 13:10:19.404096 run osmo-stp_10.42.42.5(pid=12140): Launched 13:10:19.524739 run osmo-msc_10.42.42.6: Starting osmo-msc 13:10:20.094692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12142): Launched 13:10:20.408493 run osmo-msc_10.42.42.6(pid=12143): Launched 13:10:20.584860 run osmo-stp_10.42.42.5(pid=12140): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12140)] 13:10:20.718475 run osmo-stp_10.42.42.5(pid=12140): stdout: | (launched: 2022-12-10_13:10:19.347081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:20.852008 run osmo-stp_10.42.42.5(pid=12140): stderr: | [0;m[38;5;43m20221210131019538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131019538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131019538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131019539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131019541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131019541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131019541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:20.985417 run osmo-stp_10.42.42.5(pid=12140): stdout: | (launched: 2022-12-10_13:10:19.347081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:21.111668 run osmo-stp_10.42.42.5(pid=12140): stderr: | [0;m[38;5;43m20221210131019538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131019538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131019538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131019539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131019541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131019541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131019541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:21.262370 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12140): Process ended prematurely: osmo-stp_10.42.42.5(pid=12140) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12140)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:10:21.271585 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:10:21.298833 run osmo-hlr_10.42.42.2(pid=12137): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12137)] 13:10:21.348363 run osmo-hlr_10.42.42.2(pid=12137): stdout: | (launched: 2022-12-10_13:10:18.367398) 13:10:21.399754 run osmo-hlr_10.42.42.2(pid=12137): stderr: | [0;m[1;31m20221210131018563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131018563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131018563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131018563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131018563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131018563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131018574 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131018583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131018583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131018583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:21.470810 run osmo-msc_10.42.42.6(pid=12143): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12143)] 13:10:21.520286 run osmo-msc_10.42.42.6(pid=12143): stdout: | (launched: 2022-12-10_13:10:20.351639) 13:10:21.571632 run osmo-msc_10.42.42.6(pid=12143): stderr: | [0;m[38;5;43m20221210131020675 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131020676 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff6c667ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131020676 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131020676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131020676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131020676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131020678 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131020678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131020678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131020678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:10:21.623154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12136): Terminating (SIGTERM) 13:10:21.664117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12139): Terminating (SIGTERM) 13:10:21.705416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12142): Terminating (SIGTERM) 13:10:21.746805 --- ParallelTerminationStrategy: PID 12136 died... 13:10:21.766460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12136): Terminated: ok {rc=0} 13:10:21.811923 --- ParallelTerminationStrategy: PID 12139 died... 13:10:21.831113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12139): Terminated: ok {rc=0} 13:10:21.876253 --- ParallelTerminationStrategy: PID 12142 died... 13:10:21.895402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12142): Terminated: ok {rc=0} 13:10:21.981048 bus /sierra_3: Setting Powered False 13:10:23.079958 bus /sierra_3: Setting Powered False 13:10:24.196697 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:10:25.341237 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:10:25.353045 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:10:25.423506 tst mo_mt_call_osmux.py: using LAC 28619 13:10:25.542128 tst mo_mt_call_osmux.py: using RAC 59 13:10:25.662588 tst mo_mt_call_osmux.py: using CellId 28619 13:10:25.788872 tst mo_mt_call_osmux.py: using BVCI 28620 13:10:25.904312 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:10:25.916173 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:10:25.927676 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:10:25.939100 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:10:25.950693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:10:25.962083 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:10:26.074976 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:10:26.194891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:26.686545 run create_hlr_db(pid=12145): Launched 13:10:26.814405 bus /sierra_2: Setting Powered False 13:10:27.876790 run create_hlr_db(pid=12145): Terminated: ok {rc=0} 13:10:28.301149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12147): Launched 13:10:28.597303 run osmo-hlr_10.42.42.2(pid=12148): Launched 13:10:28.710719 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:29.221994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12150): Launched 13:10:29.517853 run osmo-stp_10.42.42.5(pid=12151): Launched 13:10:29.630508 run osmo-msc_10.42.42.6: Starting osmo-msc 13:10:30.167148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12153): Launched 13:10:30.462145 run osmo-msc_10.42.42.6(pid=12154): Launched 13:10:30.627522 run osmo-stp_10.42.42.5(pid=12151): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12151)] 13:10:30.753288 run osmo-stp_10.42.42.5(pid=12151): stdout: | (launched: 2022-12-10_13:10:29.464110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:30.880687 run osmo-stp_10.42.42.5(pid=12151): stderr: | [0;m[38;5;43m20221210131029634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131029634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131029635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131029635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131029635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131029635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131029636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:31.007178 run osmo-stp_10.42.42.5(pid=12151): stdout: | (launched: 2022-12-10_13:10:29.464110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:31.127555 run osmo-stp_10.42.42.5(pid=12151): stderr: | [0;m[38;5;43m20221210131029634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131029634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131029635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131029635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131029635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131029635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131029636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:31.272064 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12151): Process ended prematurely: osmo-stp_10.42.42.5(pid=12151) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12151)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:10:31.281889 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:10:31.309981 run osmo-hlr_10.42.42.2(pid=12148): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12148)] 13:10:31.360482 run osmo-hlr_10.42.42.2(pid=12148): stdout: | (launched: 2022-12-10_13:10:28.542962) 13:10:31.411490 run osmo-hlr_10.42.42.2(pid=12148): stderr: | [0;m[1;31m20221210131028720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131028721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131028721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131028721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131028721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131028721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131028732 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131028741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131028741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131028741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:31.482600 run osmo-msc_10.42.42.6(pid=12154): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12154)] 13:10:31.532368 run osmo-msc_10.42.42.6(pid=12154): stdout: | (launched: 2022-12-10_13:10:30.408128) 13:10:31.583680 run osmo-msc_10.42.42.6(pid=12154): stderr: | [0;m[38;5;43m20221210131030681 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131030681 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f517976dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131030682 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131030682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131030682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131030682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131030684 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131030684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131030684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131030684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:10:31.635343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12147): Terminating (SIGTERM) 13:10:31.677622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12150): Terminating (SIGTERM) 13:10:31.720544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12153): Terminating (SIGTERM) 13:10:31.762742 --- ParallelTerminationStrategy: PID 12147 died... 13:10:31.782002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12147): Terminated: ok {rc=0} 13:10:31.828668 --- ParallelTerminationStrategy: PID 12150 died... 13:10:31.847802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12150): Terminated: ok {rc=0} 13:10:31.894997 --- ParallelTerminationStrategy: PID 12153 died... 13:10:31.914252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12153): Terminated: ok {rc=0} 13:10:32.002725 bus /sierra_3: Setting Powered False 13:10:33.099734 bus /sierra_3: Setting Powered False 13:10:34.210612 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:10:35.460380 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:10:35.467454 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:10:35.501745 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:10:35.528579 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:10:35.582119 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:10:35.617683 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:10:35.644676 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:10:36.193631 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:10:36.244267 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:10:36.255924 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:10:36.327204 tst mo_mt_call.py: using LAC 28620 13:10:36.453166 tst mo_mt_call.py: using RAC 60 13:10:36.577638 tst mo_mt_call.py: using CellId 28620 13:10:36.702396 tst mo_mt_call.py: using BVCI 28621 13:10:36.818819 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:10:36.830271 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:10:36.841568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:10:36.852917 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:10:36.864492 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:10:36.875951 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:10:36.990847 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:10:37.107804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:37.568442 run create_hlr_db(pid=12160): Launched 13:10:37.682812 bus /sierra_2: Setting Powered False 13:10:38.742209 run create_hlr_db(pid=12160): Terminated: ok {rc=0} 13:10:39.155604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12162): Launched 13:10:39.452420 run osmo-hlr_10.42.42.2(pid=12163): Launched 13:10:39.566419 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:40.076029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12165): Launched 13:10:40.371652 run osmo-stp_10.42.42.5(pid=12166): Launched 13:10:40.485104 run osmo-msc_10.42.42.6: Starting osmo-msc 13:10:41.025245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12168): Launched 13:10:41.321805 run osmo-msc_10.42.42.6(pid=12169): Launched 13:10:41.489615 run osmo-stp_10.42.42.5(pid=12166): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12166)] 13:10:41.617175 run osmo-stp_10.42.42.5(pid=12166): stdout: | (launched: 2022-12-10_13:10:40.317937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:41.744016 run osmo-stp_10.42.42.5(pid=12166): stderr: | [0;m[38;5;43m20221210131040485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131040485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131040486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131040486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131040487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131040487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131040487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:41.868285 run osmo-stp_10.42.42.5(pid=12166): stdout: | (launched: 2022-12-10_13:10:40.317937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:42.012085 run osmo-stp_10.42.42.5(pid=12166): stderr: | [0;m[38;5;43m20221210131040485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131040485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131040486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131040486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131040487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131040487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131040487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:42.154744 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12166): Process ended prematurely: osmo-stp_10.42.42.5(pid=12166) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12166)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:10:42.163565 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:10:42.190113 run osmo-hlr_10.42.42.2(pid=12163): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12163)] 13:10:42.237428 run osmo-hlr_10.42.42.2(pid=12163): stdout: | (launched: 2022-12-10_13:10:39.398479) 13:10:42.286452 run osmo-hlr_10.42.42.2(pid=12163): stderr: | [0;m[1;31m20221210131039574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131039574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131039574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131039574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131039574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131039574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131039586 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131039595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131039595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131039595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:42.354732 run osmo-msc_10.42.42.6(pid=12169): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12169)] 13:10:42.402014 run osmo-msc_10.42.42.6(pid=12169): stdout: | (launched: 2022-12-10_13:10:41.267423) 13:10:42.450797 run osmo-msc_10.42.42.6(pid=12169): stderr: | [0;m[38;5;43m20221210131041538 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131041538 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f263d34dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131041538 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131041538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131041538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131041539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131041541 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131041541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131041541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131041541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:10:42.500104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12162): Terminating (SIGTERM) 13:10:42.539049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12165): Terminating (SIGTERM) 13:10:42.578155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12168): Terminating (SIGTERM) 13:10:42.617959 --- ParallelTerminationStrategy: PID 12162 died... 13:10:42.636463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12162): Terminated: ok {rc=0} 13:10:42.679941 --- ParallelTerminationStrategy: PID 12165 died... 13:10:42.698254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12165): Terminated: ok {rc=0} 13:10:42.741492 --- ParallelTerminationStrategy: PID 12168 died... 13:10:42.759664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12168): Terminated: ok {rc=0} 13:10:42.843945 bus /sierra_3: Setting Powered False 13:10:43.941837 bus /sierra_3: Setting Powered False 13:10:45.056676 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:10:46.207263 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:10:46.220252 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:10:46.294234 tst mo_mt_call_osmux.py: using LAC 28621 13:10:46.420840 tst mo_mt_call_osmux.py: using RAC 61 13:10:46.547203 tst mo_mt_call_osmux.py: using CellId 28621 13:10:46.698679 tst mo_mt_call_osmux.py: using BVCI 28622 13:10:46.844108 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:10:46.858129 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:10:46.872095 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:10:46.885870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:10:46.899876 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:10:46.912771 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:10:47.033025 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:10:47.173762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:47.638638 run create_hlr_db(pid=12171): Launched 13:10:47.751889 bus /sierra_2: Setting Powered False 13:10:48.810523 run create_hlr_db(pid=12171): Terminated: ok {rc=0} 13:10:49.242891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12173): Launched 13:10:49.559730 run osmo-hlr_10.42.42.2(pid=12174): Launched 13:10:49.681418 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:50.233242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12176): Launched 13:10:50.550122 run osmo-stp_10.42.42.5(pid=12177): Launched 13:10:50.671645 run osmo-msc_10.42.42.6: Starting osmo-msc 13:10:51.245266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12179): Launched 13:10:51.562510 run osmo-msc_10.42.42.6(pid=12180): Launched 13:10:51.738987 run osmo-stp_10.42.42.5(pid=12177): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12177)] 13:10:51.872459 run osmo-stp_10.42.42.5(pid=12177): stdout: | (launched: 2022-12-10_13:10:50.492589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:52.006599 run osmo-stp_10.42.42.5(pid=12177): stderr: | [0;m[38;5;43m20221210131050684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131050684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131050684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131050685 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131050685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131050685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131050686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:52.140129 run osmo-stp_10.42.42.5(pid=12177): stdout: | (launched: 2022-12-10_13:10:50.492589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:52.266850 run osmo-stp_10.42.42.5(pid=12177): stderr: | [0;m[38;5;43m20221210131050684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131050684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131050684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131050685 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131050685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131050685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131050686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:52.417692 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12177): Process ended prematurely: osmo-stp_10.42.42.5(pid=12177) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12177)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:10:52.427246 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:10:52.454894 run osmo-hlr_10.42.42.2(pid=12174): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12174)] 13:10:52.504447 run osmo-hlr_10.42.42.2(pid=12174): stdout: | (launched: 2022-12-10_13:10:49.502442) 13:10:52.555487 run osmo-hlr_10.42.42.2(pid=12174): stderr: | [0;m[1;31m20221210131049700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131049700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131049700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131049700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131049700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131049700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131049713 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131049721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131049721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131049721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:52.626765 run osmo-msc_10.42.42.6(pid=12180): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12180)] 13:10:52.676010 run osmo-msc_10.42.42.6(pid=12180): stdout: | (launched: 2022-12-10_13:10:51.505034) 13:10:52.726788 run osmo-msc_10.42.42.6(pid=12180): stderr: | [0;m[38;5;43m20221210131051828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131051828 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f787d959c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131051828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131051828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131051828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131051828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131051830 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131051830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131051831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131051831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:10:52.778063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12173): Terminating (SIGTERM) 13:10:52.818974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12176): Terminating (SIGTERM) 13:10:52.859908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12179): Terminating (SIGTERM) 13:10:52.901445 --- ParallelTerminationStrategy: PID 12173 died... 13:10:52.920897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12173): Terminated: ok {rc=0} 13:10:52.966813 --- ParallelTerminationStrategy: PID 12176 died... 13:10:52.986110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12176): Terminated: ok {rc=0} 13:10:53.031768 --- ParallelTerminationStrategy: PID 12179 died... 13:10:53.050999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12179): Terminated: ok {rc=0} 13:10:53.138209 bus /sierra_3: Setting Powered False 13:10:54.236352 bus /sierra_3: Setting Powered False 13:10:55.351336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:10:56.601710 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:10:56.608796 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:10:56.642762 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:10:56.669802 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:10:56.722786 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:10:56.758170 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:10:56.785358 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:10:57.334976 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:10:57.386287 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:10:57.397930 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:10:57.468768 tst mo_mt_call.py: using LAC 28622 13:10:57.593380 tst mo_mt_call.py: using RAC 62 13:10:57.718658 tst mo_mt_call.py: using CellId 28622 13:10:57.844640 tst mo_mt_call.py: using BVCI 28623 13:10:57.959695 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:10:57.971094 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:10:57.982337 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:10:57.993959 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:10:58.005545 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:10:58.017209 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:10:58.132205 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:10:58.251482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:58.743780 run create_hlr_db(pid=12185): Launched 13:10:58.871807 bus /sierra_2: Setting Powered False 13:10:59.934244 run create_hlr_db(pid=12185): Terminated: ok {rc=0} 13:11:00.357052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12187): Launched 13:11:00.653562 run osmo-hlr_10.42.42.2(pid=12188): Launched 13:11:00.767790 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:01.427111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12190): Launched 13:11:01.774416 run osmo-stp_10.42.42.5(pid=12191): Launched 13:11:02.053203 run osmo-msc_10.42.42.6: Starting osmo-msc 13:11:02.629345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12193): Launched 13:11:02.946860 run osmo-msc_10.42.42.6(pid=12194): Launched 13:11:03.124575 run osmo-stp_10.42.42.5(pid=12191): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12191)] 13:11:03.258313 run osmo-stp_10.42.42.5(pid=12191): stdout: | (launched: 2022-12-10_13:11:01.701883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:03.392633 run osmo-stp_10.42.42.5(pid=12191): stderr: | [0;m[38;5;43m20221210131101909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131101909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131101909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131101910 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131101910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131101910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131101910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:03.527239 run osmo-stp_10.42.42.5(pid=12191): stdout: | (launched: 2022-12-10_13:11:01.701883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:03.653808 run osmo-stp_10.42.42.5(pid=12191): stderr: | [0;m[38;5;43m20221210131101909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131101909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131101909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131101910 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131101910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131101910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131101910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:03.806072 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12191): Process ended prematurely: osmo-stp_10.42.42.5(pid=12191) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12191)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:11:03.815665 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:11:03.843295 run osmo-hlr_10.42.42.2(pid=12188): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12188)] 13:11:03.893299 run osmo-hlr_10.42.42.2(pid=12188): stdout: | (launched: 2022-12-10_13:11:00.599686) 13:11:03.944795 run osmo-hlr_10.42.42.2(pid=12188): stderr: | [0;m[1;31m20221210131100774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131100774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131100774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131100775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131100775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131100775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131100790 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131100798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131100799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131100799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:04.016642 run osmo-msc_10.42.42.6(pid=12194): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12194)] 13:11:04.066070 run osmo-msc_10.42.42.6(pid=12194): stdout: | (launched: 2022-12-10_13:11:02.889348) 13:11:04.117338 run osmo-msc_10.42.42.6(pid=12194): stderr: | [0;m[38;5;43m20221210131103210 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131103210 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f11ab5efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131103210 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131103210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131103210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131103210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131103212 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131103212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131103213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131103213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:11:04.168891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12187): Terminating (SIGTERM) 13:11:04.209997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12190): Terminating (SIGTERM) 13:11:04.251289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12193): Terminating (SIGTERM) 13:11:04.292866 --- ParallelTerminationStrategy: PID 12187 died... 13:11:04.312562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12187): Terminated: ok {rc=0} 13:11:04.358567 --- ParallelTerminationStrategy: PID 12190 died... 13:11:04.377881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12190): Terminated: ok {rc=0} 13:11:04.423510 --- ParallelTerminationStrategy: PID 12193 died... 13:11:04.442837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12193): Terminated: ok {rc=0} 13:11:04.529849 bus /sierra_3: Setting Powered False 13:11:05.628162 bus /sierra_3: Setting Powered False 13:11:06.743373 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:11:07.890350 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:11:07.902578 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:11:07.973444 tst mo_mt_call_osmux.py: using LAC 28623 13:11:08.092408 tst mo_mt_call_osmux.py: using RAC 63 13:11:08.210196 tst mo_mt_call_osmux.py: using CellId 28623 13:11:08.332449 tst mo_mt_call_osmux.py: using BVCI 28624 13:11:08.443156 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:11:08.454445 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:11:08.465515 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:11:08.476715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:11:08.487863 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:11:08.498894 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:11:08.617502 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:11:08.734435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:09.197478 run create_hlr_db(pid=12196): Launched 13:11:09.311583 bus /sierra_2: Setting Powered False 13:11:10.370560 run create_hlr_db(pid=12196): Terminated: ok {rc=0} 13:11:10.785088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12198): Launched 13:11:11.081929 run osmo-hlr_10.42.42.2(pid=12199): Launched 13:11:11.195758 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:11.720265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12201): Launched 13:11:12.017369 run osmo-stp_10.42.42.5(pid=12202): Launched 13:11:12.131560 run osmo-msc_10.42.42.6: Starting osmo-msc 13:11:12.670918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12204): Launched 13:11:12.969288 run osmo-msc_10.42.42.6(pid=12205): Launched 13:11:13.136715 run osmo-stp_10.42.42.5(pid=12202): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12202)] 13:11:13.263982 run osmo-stp_10.42.42.5(pid=12202): stdout: | (launched: 2022-12-10_13:11:11.963234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:13.391720 run osmo-stp_10.42.42.5(pid=12202): stderr: | [0;m[38;5;43m20221210131112134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131112134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131112134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131112135 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131112135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131112135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131112135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:13.516318 run osmo-stp_10.42.42.5(pid=12202): stdout: | (launched: 2022-12-10_13:11:11.963234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:13.635873 run osmo-stp_10.42.42.5(pid=12202): stderr: | [0;m[38;5;43m20221210131112134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131112134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131112134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131112135 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131112135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131112135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131112135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:13.778033 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12202): Process ended prematurely: osmo-stp_10.42.42.5(pid=12202) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12202)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:11:13.787078 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 13:11:13.814044 run osmo-hlr_10.42.42.2(pid=12199): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12199)] 13:11:13.861922 run osmo-hlr_10.42.42.2(pid=12199): stdout: | (launched: 2022-12-10_13:11:11.027942) 13:11:13.911040 run osmo-hlr_10.42.42.2(pid=12199): stderr: | [0;m[1;31m20221210131111199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131111199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131111199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131111199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131111199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131111199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131111211 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131111219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131111219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131111219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:13.979711 run osmo-msc_10.42.42.6(pid=12205): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12205)] 13:11:14.027578 run osmo-msc_10.42.42.6(pid=12205): stdout: | (launched: 2022-12-10_13:11:12.914676) 13:11:14.076380 run osmo-msc_10.42.42.6(pid=12205): stderr: | [0;m[38;5;43m20221210131113186 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131113186 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61c8058c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131113186 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131113186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131113187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131113187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131113189 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131113189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131113190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131113190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:11:14.126367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12198): Terminating (SIGTERM) 13:11:14.165655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12201): Terminating (SIGTERM) 13:11:14.205081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12204): Terminating (SIGTERM) 13:11:14.245089 --- ParallelTerminationStrategy: PID 12198 died... 13:11:14.263692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12198): Terminated: ok {rc=0} 13:11:14.308151 --- ParallelTerminationStrategy: PID 12201 died... 13:11:14.326619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12201): Terminated: ok {rc=0} 13:11:14.371166 --- ParallelTerminationStrategy: PID 12204 died... 13:11:14.389595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12204): Terminated: ok {rc=0} 13:11:14.474589 bus /sierra_3: Setting Powered False 13:11:15.571167 bus /sierra_3: Setting Powered False 13:11:16.695269 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:11:17.962688 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:17.971219 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:11:18.006394 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:11:18.033261 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:11:18.083152 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:11:18.117137 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:11:18.144130 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:11:18.702884 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:11:18.753047 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:11:18.764497 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:11:18.833050 tst mo_mt_call.py: using LAC 28624 13:11:18.955855 tst mo_mt_call.py: using RAC 64 13:11:19.078485 tst mo_mt_call.py: using CellId 28624 13:11:19.201844 tst mo_mt_call.py: using BVCI 28625 13:11:19.316887 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:11:19.328282 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:11:19.339601 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:11:19.350925 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:11:19.362275 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:11:19.373524 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:11:19.488189 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:11:19.603538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:20.096151 run create_hlr_db(pid=12211): Launched 13:11:20.225180 bus /sierra_2: Setting Powered False 13:11:21.288017 run create_hlr_db(pid=12211): Terminated: ok {rc=0} 13:11:21.712701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12213): Launched 13:11:22.009633 run osmo-hlr_10.42.42.2(pid=12214): Launched 13:11:22.124122 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:22.650001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12216): Launched 13:11:22.945821 run osmo-stp_10.42.42.5(pid=12217): Launched 13:11:23.059084 run osmo-msc_10.42.42.6: Starting osmo-msc 13:11:23.596538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12219): Launched 13:11:23.894783 run osmo-msc_10.42.42.6(pid=12220): Launched 13:11:24.061932 run osmo-stp_10.42.42.5(pid=12217): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12217)] 13:11:24.188783 run osmo-stp_10.42.42.5(pid=12217): stdout: | (launched: 2022-12-10_13:11:22.891951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:24.317479 run osmo-stp_10.42.42.5(pid=12217): stderr: | [0;m[38;5;43m20221210131123060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131123060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131123061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131123061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131123062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131123062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131123062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:24.442172 run osmo-stp_10.42.42.5(pid=12217): stdout: | (launched: 2022-12-10_13:11:22.891951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:24.561227 run osmo-stp_10.42.42.5(pid=12217): stderr: | [0;m[38;5;43m20221210131123060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131123060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131123061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131123061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131123062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131123062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131123062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:24.703441 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12217): Process ended prematurely: osmo-stp_10.42.42.5(pid=12217) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12217)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:11:24.712322 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:11:24.739156 run osmo-hlr_10.42.42.2(pid=12214): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12214)] 13:11:24.786971 run osmo-hlr_10.42.42.2(pid=12214): stdout: | (launched: 2022-12-10_13:11:21.955595) 13:11:24.836316 run osmo-hlr_10.42.42.2(pid=12214): stderr: | [0;m[1;31m20221210131122130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131122130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131122130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131122130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131122130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131122130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131122143 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131122153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131122153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131122153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:24.904712 run osmo-msc_10.42.42.6(pid=12220): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12220)] 13:11:24.952257 run osmo-msc_10.42.42.6(pid=12220): stdout: | (launched: 2022-12-10_13:11:23.840253) 13:11:25.001390 run osmo-msc_10.42.42.6(pid=12220): stderr: | [0;m[38;5;43m20221210131124110 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131124110 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f218a530c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131124111 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131124111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131124111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131124111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131124113 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131124113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131124113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131124113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:11:25.051227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12213): Terminating (SIGTERM) 13:11:25.090747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12216): Terminating (SIGTERM) 13:11:25.130455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12219): Terminating (SIGTERM) 13:11:25.170450 --- ParallelTerminationStrategy: PID 12213 died... 13:11:25.189331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12213): Terminated: ok {rc=0} 13:11:25.233568 --- ParallelTerminationStrategy: PID 12216 died... 13:11:25.251604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12216): Terminated: ok {rc=0} 13:11:25.295085 --- ParallelTerminationStrategy: PID 12219 died... 13:11:25.313355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12219): Terminated: ok {rc=0} 13:11:25.398610 bus /sierra_3: Setting Powered False 13:11:26.495701 bus /sierra_3: Setting Powered False 13:11:27.611149 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:11:28.758098 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:11:28.770331 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:11:28.841150 tst mo_mt_call_osmux.py: using LAC 28625 13:11:28.965273 tst mo_mt_call_osmux.py: using RAC 65 13:11:29.090566 tst mo_mt_call_osmux.py: using CellId 28625 13:11:29.215499 tst mo_mt_call_osmux.py: using BVCI 28626 13:11:29.331302 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:11:29.342921 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:11:29.354614 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:11:29.366117 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:11:29.377683 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:11:29.389199 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:11:29.508754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:11:29.624581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:30.087609 run create_hlr_db(pid=12223): Launched 13:11:30.202247 bus /sierra_2: Setting Powered False 13:11:31.264624 run create_hlr_db(pid=12223): Terminated: ok {rc=0} 13:11:31.732215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12225): Launched 13:11:32.044334 run osmo-hlr_10.42.42.2(pid=12226): Launched 13:11:32.212191 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:32.778610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12228): Launched 13:11:33.075448 run osmo-stp_10.42.42.5(pid=12229): Launched 13:11:33.190119 run osmo-msc_10.42.42.6: Starting osmo-msc 13:11:33.743116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12231): Launched 13:11:34.039262 run osmo-msc_10.42.42.6(pid=12232): Launched 13:11:34.205866 run osmo-stp_10.42.42.5(pid=12229): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12229)] 13:11:34.332399 run osmo-stp_10.42.42.5(pid=12229): stdout: | (launched: 2022-12-10_13:11:33.021473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:34.459554 run osmo-stp_10.42.42.5(pid=12229): stderr: | [0;m[38;5;43m20221210131133191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131133191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131133192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131133192 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131133193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131133193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131133193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:34.583741 run osmo-stp_10.42.42.5(pid=12229): stdout: | (launched: 2022-12-10_13:11:33.021473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:34.702065 run osmo-stp_10.42.42.5(pid=12229): stderr: | [0;m[38;5;43m20221210131133191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131133191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131133192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131133192 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131133193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131133193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131133193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:34.843752 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12229): Process ended prematurely: osmo-stp_10.42.42.5(pid=12229) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12229)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:11:34.852716 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:11:34.878862 run osmo-hlr_10.42.42.2(pid=12226): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12226)] 13:11:34.926336 run osmo-hlr_10.42.42.2(pid=12226): stdout: | (launched: 2022-12-10_13:11:31.984046) 13:11:34.975367 run osmo-hlr_10.42.42.2(pid=12226): stderr: | [0;m[1;31m20221210131132312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131132312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131132312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131132312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131132312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131132312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131132324 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131132334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131132334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131132334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:35.044101 run osmo-msc_10.42.42.6(pid=12232): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12232)] 13:11:35.091638 run osmo-msc_10.42.42.6(pid=12232): stdout: | (launched: 2022-12-10_13:11:33.985145) 13:11:35.140387 run osmo-msc_10.42.42.6(pid=12232): stderr: | [0;m[38;5;43m20221210131134255 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131134255 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fae20139c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131134255 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131134255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131134256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131134256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131134258 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131134258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131134259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131134259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:11:35.189771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12225): Terminating (SIGTERM) 13:11:35.229129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12228): Terminating (SIGTERM) 13:11:35.268825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12231): Terminating (SIGTERM) 13:11:35.309152 --- ParallelTerminationStrategy: PID 12225 died... 13:11:35.327840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12225): Terminated: ok {rc=0} 13:11:35.371743 --- ParallelTerminationStrategy: PID 12228 died... 13:11:35.390163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12228): Terminated: ok {rc=0} 13:11:35.433740 --- ParallelTerminationStrategy: PID 12231 died... 13:11:35.452159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12231): Terminated: ok {rc=0} 13:11:35.537233 bus /sierra_3: Setting Powered False 13:11:36.634202 bus /sierra_3: Setting Powered False 13:11:37.748542 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:11:38.994149 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:39.000392 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:11:39.033939 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:11:39.059776 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:11:39.109747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:11:39.142931 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:11:39.168881 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:11:39.725634 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:11:39.776800 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:11:39.788474 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:11:39.861582 tst mo_mt_call.py: using LAC 28626 13:11:39.986327 tst mo_mt_call.py: using RAC 66 13:11:40.109910 tst mo_mt_call.py: using CellId 28626 13:11:40.233474 tst mo_mt_call.py: using BVCI 28627 13:11:40.349416 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:11:40.360872 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:11:40.372297 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:11:40.383580 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:11:40.394952 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:11:40.406291 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:11:40.521348 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:11:40.641022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:41.134270 run create_hlr_db(pid=12237): Launched 13:11:41.262865 bus /sierra_2: Setting Powered False 13:11:42.326162 run create_hlr_db(pid=12237): Terminated: ok {rc=0} 13:11:42.750266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12239): Launched 13:11:43.047571 run osmo-hlr_10.42.42.2(pid=12240): Launched 13:11:43.161174 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:43.687259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12242): Launched 13:11:43.984410 run osmo-stp_10.42.42.5(pid=12243): Launched 13:11:44.097831 run osmo-msc_10.42.42.6: Starting osmo-msc 13:11:44.637402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12245): Launched 13:11:44.937667 run osmo-msc_10.42.42.6(pid=12246): Launched 13:11:45.104859 run osmo-stp_10.42.42.5(pid=12243): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12243)] 13:11:45.231906 run osmo-stp_10.42.42.5(pid=12243): stdout: | (launched: 2022-12-10_13:11:43.930046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:45.358926 run osmo-stp_10.42.42.5(pid=12243): stderr: | [0;m[38;5;43m20221210131144101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131144101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131144101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131144101 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131144102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131144102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131144102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:45.483629 run osmo-stp_10.42.42.5(pid=12243): stdout: | (launched: 2022-12-10_13:11:43.930046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:45.602734 run osmo-stp_10.42.42.5(pid=12243): stderr: | [0;m[38;5;43m20221210131144101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131144101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131144101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131144101 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131144102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131144102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131144102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:45.745433 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12243): Process ended prematurely: osmo-stp_10.42.42.5(pid=12243) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12243)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:11:45.754176 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:11:45.780734 run osmo-hlr_10.42.42.2(pid=12240): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12240)] 13:11:45.828806 run osmo-hlr_10.42.42.2(pid=12240): stdout: | (launched: 2022-12-10_13:11:42.993238) 13:11:45.879212 run osmo-hlr_10.42.42.2(pid=12240): stderr: | [0;m[1;31m20221210131143170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131143171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131143171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131143171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131143171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131143171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131143182 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131143191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131143191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131143191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:45.962116 run osmo-msc_10.42.42.6(pid=12246): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12246)] 13:11:46.011185 run osmo-msc_10.42.42.6(pid=12246): stdout: | (launched: 2022-12-10_13:11:44.882861) 13:11:46.065413 run osmo-msc_10.42.42.6(pid=12246): stderr: | [0;m[38;5;43m20221210131145153 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131145153 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb7854ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131145153 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131145153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131145153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131145153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131145156 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131145156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131145156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131145156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:11:46.119874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12239): Terminating (SIGTERM) 13:11:46.163092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12242): Terminating (SIGTERM) 13:11:46.209081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12245): Terminating (SIGTERM) 13:11:46.254312 --- ParallelTerminationStrategy: PID 12239 died... 13:11:46.274691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12239): Terminated: ok {rc=0} 13:11:46.324339 --- ParallelTerminationStrategy: PID 12242 died... 13:11:46.344878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12242): Terminated: ok {rc=0} 13:11:46.391803 --- ParallelTerminationStrategy: PID 12245 died... 13:11:46.411710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12245): Terminated: ok {rc=0} 13:11:46.500917 bus /sierra_3: Setting Powered False 13:11:47.599881 bus /sierra_3: Setting Powered False 13:11:48.715709 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:11:49.861612 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:11:49.873287 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:11:49.945212 tst mo_mt_call_osmux.py: using LAC 28627 13:11:50.062401 tst mo_mt_call_osmux.py: using RAC 67 13:11:50.178191 tst mo_mt_call_osmux.py: using CellId 28627 13:11:50.296864 tst mo_mt_call_osmux.py: using BVCI 28628 13:11:50.405646 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:11:50.416680 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:11:50.427509 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:11:50.438701 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:11:50.450141 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:11:50.461451 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:11:50.581140 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:11:50.699843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:51.195167 run create_hlr_db(pid=12248): Launched 13:11:51.323862 bus /sierra_2: Setting Powered False 13:11:52.386499 run create_hlr_db(pid=12248): Terminated: ok {rc=0} 13:11:52.810718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12250): Launched 13:11:53.108773 run osmo-hlr_10.42.42.2(pid=12251): Launched 13:11:53.222664 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:53.746421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12253): Launched 13:11:54.044313 run osmo-stp_10.42.42.5(pid=12254): Launched 13:11:54.157614 run osmo-msc_10.42.42.6: Starting osmo-msc 13:11:54.696856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12256): Launched 13:11:54.996409 run osmo-msc_10.42.42.6(pid=12257): Launched 13:11:55.164457 run osmo-stp_10.42.42.5(pid=12254): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12254)] 13:11:55.292159 run osmo-stp_10.42.42.5(pid=12254): stdout: | (launched: 2022-12-10_13:11:53.989992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:55.419593 run osmo-stp_10.42.42.5(pid=12254): stderr: | [0;m[38;5;43m20221210131154159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131154159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131154159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131154160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131154160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131154160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131154160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:55.544346 run osmo-stp_10.42.42.5(pid=12254): stdout: | (launched: 2022-12-10_13:11:53.989992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:55.663043 run osmo-stp_10.42.42.5(pid=12254): stderr: | [0;m[38;5;43m20221210131154159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131154159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131154159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131154160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131154160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131154160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131154160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:55.805460 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12254): Process ended prematurely: osmo-stp_10.42.42.5(pid=12254) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12254)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:11:55.814489 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:11:55.841353 run osmo-hlr_10.42.42.2(pid=12251): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12251)] 13:11:55.889357 run osmo-hlr_10.42.42.2(pid=12251): stdout: | (launched: 2022-12-10_13:11:53.054338) 13:11:55.938820 run osmo-hlr_10.42.42.2(pid=12251): stderr: | [0;m[1;31m20221210131153228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131153228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131153229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131153229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131153229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131153229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131153240 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131153250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131153250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131153250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:56.007270 run osmo-msc_10.42.42.6(pid=12257): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12257)] 13:11:56.054792 run osmo-msc_10.42.42.6(pid=12257): stdout: | (launched: 2022-12-10_13:11:54.941690) 13:11:56.103956 run osmo-msc_10.42.42.6(pid=12257): stderr: | [0;m[38;5;43m20221210131155215 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131155215 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa49d282c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131155215 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131155215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131155215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131155215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131155217 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131155218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131155218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131155218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:11:56.153706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12250): Terminating (SIGTERM) 13:11:56.193267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12253): Terminating (SIGTERM) 13:11:56.232779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12256): Terminating (SIGTERM) 13:11:56.272536 --- ParallelTerminationStrategy: PID 12250 died... 13:11:56.291329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12250): Terminated: ok {rc=0} 13:11:56.335343 --- ParallelTerminationStrategy: PID 12253 died... 13:11:56.353791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12253): Terminated: ok {rc=0} 13:11:56.397488 --- ParallelTerminationStrategy: PID 12256 died... 13:11:56.415915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12256): Terminated: ok {rc=0} 13:11:56.498094 bus /sierra_3: Setting Powered False 13:11:57.595139 bus /sierra_3: Setting Powered False 13:11:58.710819 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:11:59.966122 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:59.973398 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:12:00.007104 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:12:00.033853 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:12:00.083722 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:12:00.117860 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:12:00.144418 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:12:00.699122 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:12:00.749232 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:12:00.760690 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:12:00.836921 tst mo_mt_call.py: using LAC 28628 13:12:00.965028 tst mo_mt_call.py: using RAC 68 13:12:01.087162 tst mo_mt_call.py: using CellId 28628 13:12:01.209790 tst mo_mt_call.py: using BVCI 28629 13:12:01.324021 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:12:01.336255 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:12:01.348238 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:12:01.362114 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:12:01.375298 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:12:01.387434 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:12:01.510651 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:12:01.657679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:02.167440 run create_hlr_db(pid=12263): Launched 13:12:02.319189 bus /sierra_2: Setting Powered False 13:12:03.382042 run create_hlr_db(pid=12263): Terminated: ok {rc=0} 13:12:03.806344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12265): Launched 13:12:04.104003 run osmo-hlr_10.42.42.2(pid=12266): Launched 13:12:04.217483 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:04.745961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12268): Launched 13:12:05.042563 run osmo-stp_10.42.42.5(pid=12269): Launched 13:12:05.155707 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:05.694632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12271): Launched 13:12:05.991727 run osmo-msc_10.42.42.6(pid=12272): Launched 13:12:06.159363 run osmo-stp_10.42.42.5(pid=12269): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12269)] 13:12:06.286461 run osmo-stp_10.42.42.5(pid=12269): stdout: | (launched: 2022-12-10_13:12:04.988414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:06.413395 run osmo-stp_10.42.42.5(pid=12269): stderr: | [0;m[38;5;43m20221210131205163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131205163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131205163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131205164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131205164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131205165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131205165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:06.537727 run osmo-stp_10.42.42.5(pid=12269): stdout: | (launched: 2022-12-10_13:12:04.988414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:06.656015 run osmo-stp_10.42.42.5(pid=12269): stderr: | [0;m[38;5;43m20221210131205163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131205163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131205163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131205164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131205164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131205165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131205165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:06.798124 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12269): Process ended prematurely: osmo-stp_10.42.42.5(pid=12269) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12269)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:12:06.806753 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:12:06.833185 run osmo-hlr_10.42.42.2(pid=12266): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12266)] 13:12:06.880600 run osmo-hlr_10.42.42.2(pid=12266): stdout: | (launched: 2022-12-10_13:12:04.049367) 13:12:06.929538 run osmo-hlr_10.42.42.2(pid=12266): stderr: | [0;m[1;31m20221210131204223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131204223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131204223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131204223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131204223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131204223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131204235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131204244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131204244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131204244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:06.997360 run osmo-msc_10.42.42.6(pid=12272): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12272)] 13:12:07.044293 run osmo-msc_10.42.42.6(pid=12272): stdout: | (launched: 2022-12-10_13:12:05.937310) 13:12:07.093059 run osmo-msc_10.42.42.6(pid=12272): stderr: | [0;m[38;5;43m20221210131206210 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131206210 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f84928c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131206210 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131206211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131206211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131206211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131206213 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131206213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131206213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131206213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:07.142363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12265): Terminating (SIGTERM) 13:12:07.181484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12268): Terminating (SIGTERM) 13:12:07.220918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12271): Terminating (SIGTERM) 13:12:07.260853 --- ParallelTerminationStrategy: PID 12265 died... 13:12:07.280035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12265): Terminated: ok {rc=0} 13:12:07.324124 --- ParallelTerminationStrategy: PID 12268 died... 13:12:07.342411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12268): Terminated: ok {rc=0} 13:12:07.385719 --- ParallelTerminationStrategy: PID 12271 died... 13:12:07.403914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12271): Terminated: ok {rc=0} 13:12:07.487369 bus /sierra_3: Setting Powered False 13:12:08.584281 bus /sierra_3: Setting Powered False 13:12:09.698561 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:12:10.841710 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:12:10.853641 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:12:10.922778 tst mo_mt_call_osmux.py: using LAC 28629 13:12:11.041714 tst mo_mt_call_osmux.py: using RAC 69 13:12:11.157531 tst mo_mt_call_osmux.py: using CellId 28629 13:12:11.273743 tst mo_mt_call_osmux.py: using BVCI 28630 13:12:11.391630 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:12:11.403470 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:12:11.415332 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:12:11.427042 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:12:11.438766 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:12:11.450431 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:12:11.568303 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:12:11.684452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:12.147236 run create_hlr_db(pid=12274): Launched 13:12:12.261992 bus /sierra_2: Setting Powered False 13:12:13.320482 run create_hlr_db(pid=12274): Terminated: ok {rc=0} 13:12:13.754320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12276): Launched 13:12:14.071148 run osmo-hlr_10.42.42.2(pid=12277): Launched 13:12:14.193153 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:14.741586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12279): Launched 13:12:15.058609 run osmo-stp_10.42.42.5(pid=12280): Launched 13:12:15.180480 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:15.754862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12282): Launched 13:12:16.089688 run osmo-msc_10.42.42.6(pid=12283): Launched 13:12:16.442820 run osmo-stp_10.42.42.5(pid=12280): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12280)] 13:12:16.682994 run osmo-stp_10.42.42.5(pid=12280): stdout: | (launched: 2022-12-10_13:12:15.001131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:16.868038 run osmo-stp_10.42.42.5(pid=12280): stderr: | [0;m[38;5;43m20221210131215193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131215193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131215193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131215193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131215194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131215194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131215194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:17.039764 run osmo-stp_10.42.42.5(pid=12280): stdout: | (launched: 2022-12-10_13:12:15.001131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:17.163169 run osmo-stp_10.42.42.5(pid=12280): stderr: | [0;m[38;5;43m20221210131215193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131215193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131215193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131215193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131215194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131215194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131215194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:17.311173 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12280): Process ended prematurely: osmo-stp_10.42.42.5(pid=12280) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12280)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:12:17.320888 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:12:17.350326 run osmo-hlr_10.42.42.2(pid=12277): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12277)] 13:12:17.401065 run osmo-hlr_10.42.42.2(pid=12277): stdout: | (launched: 2022-12-10_13:12:14.013451) 13:12:17.453112 run osmo-hlr_10.42.42.2(pid=12277): stderr: | [0;m[1;31m20221210131214212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131214212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131214212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131214212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131214212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131214212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131214225 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131214233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131214233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131214233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:17.525526 run osmo-msc_10.42.42.6(pid=12283): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12283)] 13:12:17.575867 run osmo-msc_10.42.42.6(pid=12283): stdout: | (launched: 2022-12-10_13:12:16.017423) 13:12:17.627279 run osmo-msc_10.42.42.6(pid=12283): stderr: | [0;m[38;5;43m20221210131216518 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131216519 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd30b7dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131216519 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131216519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131216519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131216519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131216527 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131216528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131216528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131216528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:17.680195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12276): Terminating (SIGTERM) 13:12:17.722463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12279): Terminating (SIGTERM) 13:12:17.764451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12282): Terminating (SIGTERM) 13:12:17.806763 --- ParallelTerminationStrategy: PID 12276 died... 13:12:17.826652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12276): Terminated: ok {rc=0} 13:12:17.873844 --- ParallelTerminationStrategy: PID 12279 died... 13:12:17.893419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12279): Terminated: ok {rc=0} 13:12:17.940357 --- ParallelTerminationStrategy: PID 12282 died... 13:12:17.959781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12282): Terminated: ok {rc=0} 13:12:18.047505 bus /sierra_3: Setting Powered False 13:12:19.145913 bus /sierra_3: Setting Powered False 13:12:20.260113 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:12:21.511286 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:12:21.517492 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:12:21.551550 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:12:21.578747 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:12:21.630572 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:12:21.664586 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:12:21.691469 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:12:22.240346 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:12:22.289279 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:12:22.300223 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:12:22.369397 tst mo_mt_call.py: using LAC 28630 13:12:22.486867 tst mo_mt_call.py: using RAC 70 13:12:22.607126 tst mo_mt_call.py: using CellId 28630 13:12:22.730075 tst mo_mt_call.py: using BVCI 28631 13:12:22.840548 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:12:22.851638 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:12:22.862742 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:12:22.874200 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:12:22.885948 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:12:22.897172 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:12:23.015959 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:12:23.132848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:23.626578 run create_hlr_db(pid=12288): Launched 13:12:23.754943 bus /sierra_2: Setting Powered False 13:12:24.817723 run create_hlr_db(pid=12288): Terminated: ok {rc=0} 13:12:25.242025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12290): Launched 13:12:25.539483 run osmo-hlr_10.42.42.2(pid=12291): Launched 13:12:25.655563 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:26.185909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12293): Launched 13:12:26.482795 run osmo-stp_10.42.42.5(pid=12294): Launched 13:12:26.597081 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:27.136409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12296): Launched 13:12:27.434597 run osmo-msc_10.42.42.6(pid=12297): Launched 13:12:27.604210 run osmo-stp_10.42.42.5(pid=12294): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12294)] 13:12:27.732253 run osmo-stp_10.42.42.5(pid=12294): stdout: | (launched: 2022-12-10_13:12:26.428751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:27.859438 run osmo-stp_10.42.42.5(pid=12294): stderr: | [0;m[38;5;43m20221210131226598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131226599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131226599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131226599 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131226600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131226600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131226600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:27.984844 run osmo-stp_10.42.42.5(pid=12294): stdout: | (launched: 2022-12-10_13:12:26.428751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:28.103756 run osmo-stp_10.42.42.5(pid=12294): stderr: | [0;m[38;5;43m20221210131226598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131226599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131226599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131226599 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131226600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131226600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131226600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:28.246545 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12294): Process ended prematurely: osmo-stp_10.42.42.5(pid=12294) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12294)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:12:28.255487 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:12:28.282035 run osmo-hlr_10.42.42.2(pid=12291): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12291)] 13:12:28.329960 run osmo-hlr_10.42.42.2(pid=12291): stdout: | (launched: 2022-12-10_13:12:25.485256) 13:12:28.379241 run osmo-hlr_10.42.42.2(pid=12291): stderr: | [0;m[1;31m20221210131225660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131225660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131225660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131225660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131225660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131225661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131225671 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131225680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131225680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131225680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:28.447586 run osmo-msc_10.42.42.6(pid=12297): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12297)] 13:12:28.494882 run osmo-msc_10.42.42.6(pid=12297): stdout: | (launched: 2022-12-10_13:12:27.379969) 13:12:28.543792 run osmo-msc_10.42.42.6(pid=12297): stderr: | [0;m[38;5;43m20221210131227651 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131227651 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd372072c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131227651 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131227651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131227651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131227652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131227655 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131227656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131227656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131227656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:28.593220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12290): Terminating (SIGTERM) 13:12:28.632395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12293): Terminating (SIGTERM) 13:12:28.671555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12296): Terminating (SIGTERM) 13:12:28.711068 --- ParallelTerminationStrategy: PID 12290 died... 13:12:28.729739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12290): Terminated: ok {rc=0} 13:12:28.773708 --- ParallelTerminationStrategy: PID 12293 died... 13:12:28.791860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12293): Terminated: ok {rc=0} 13:12:28.835698 --- ParallelTerminationStrategy: PID 12296 died... 13:12:28.854161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12296): Terminated: ok {rc=0} 13:12:28.938215 bus /sierra_3: Setting Powered False 13:12:30.034520 bus /sierra_3: Setting Powered False 13:12:31.153568 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:12:32.305674 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:12:32.317365 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:12:32.389718 tst mo_mt_call_osmux.py: using LAC 28631 13:12:32.509372 tst mo_mt_call_osmux.py: using RAC 71 13:12:32.626863 tst mo_mt_call_osmux.py: using CellId 28631 13:12:32.750017 tst mo_mt_call_osmux.py: using BVCI 28632 13:12:32.861610 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:12:32.872567 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:12:32.883560 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:12:32.894981 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:12:32.906530 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:12:32.917935 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:12:33.039004 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:12:33.162659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:33.624623 run create_hlr_db(pid=12299): Launched 13:12:33.737660 bus /sierra_2: Setting Powered False 13:12:34.796184 run create_hlr_db(pid=12299): Terminated: ok {rc=0} 13:12:35.209148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12301): Launched 13:12:35.505638 run osmo-hlr_10.42.42.2(pid=12302): Launched 13:12:35.620178 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:36.156064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12305): Launched 13:12:36.458352 run osmo-stp_10.42.42.5(pid=12306): Launched 13:12:36.572206 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:37.110619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12308): Launched 13:12:37.408508 run osmo-msc_10.42.42.6(pid=12309): Launched 13:12:37.577677 run osmo-stp_10.42.42.5(pid=12306): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12306)] 13:12:37.705198 run osmo-stp_10.42.42.5(pid=12306): stdout: | (launched: 2022-12-10_13:12:36.404447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:37.832511 run osmo-stp_10.42.42.5(pid=12306): stderr: | [0;m[38;5;43m20221210131236573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131236574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131236574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131236574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131236575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131236575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131236575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:37.957943 run osmo-stp_10.42.42.5(pid=12306): stdout: | (launched: 2022-12-10_13:12:36.404447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:38.076867 run osmo-stp_10.42.42.5(pid=12306): stderr: | [0;m[38;5;43m20221210131236573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131236574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131236574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131236574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131236575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131236575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131236575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:38.220010 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12306): Process ended prematurely: osmo-stp_10.42.42.5(pid=12306) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12306)] [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:12:38.229094 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:12:38.256055 run osmo-hlr_10.42.42.2(pid=12302): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12302)] 13:12:38.303894 run osmo-hlr_10.42.42.2(pid=12302): stdout: | (launched: 2022-12-10_13:12:35.451628) 13:12:38.353129 run osmo-hlr_10.42.42.2(pid=12302): stderr: | [0;m[1;31m20221210131235624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131235624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131235624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131235625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131235625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131235625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131235637 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131235645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131235645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131235645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:38.421391 run osmo-msc_10.42.42.6(pid=12309): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12309)] 13:12:38.469019 run osmo-msc_10.42.42.6(pid=12309): stdout: | (launched: 2022-12-10_13:12:37.354385) 13:12:38.518020 run osmo-msc_10.42.42.6(pid=12309): stderr: | [0;m[38;5;43m20221210131237625 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131237625 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f385bc35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131237625 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131237625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131237625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131237626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131237627 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131237628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131237628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131237628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:38.567386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12301): Terminating (SIGTERM) 13:12:38.607045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12305): Terminating (SIGTERM) 13:12:38.646506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12308): Terminating (SIGTERM) 13:12:38.686159 --- ParallelTerminationStrategy: PID 12301 died... 13:12:38.704810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12301): Terminated: ok {rc=0} 13:12:38.749302 --- ParallelTerminationStrategy: PID 12305 died... 13:12:38.767707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12305): Terminated: ok {rc=0} 13:12:38.811418 --- ParallelTerminationStrategy: PID 12308 died... 13:12:38.829775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12308): Terminated: ok {rc=0} 13:12:38.915691 bus /sierra_3: Setting Powered False 13:12:40.014370 bus /sierra_3: Setting Powered False 13:12:41.129512 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 13:12:42.379115 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:12:42.384047 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:12:42.419040 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:12:42.446346 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 13:12:42.537071 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:12:42.571270 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:12:42.598555 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 13:12:43.178454 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2375 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 13:12:43.183433 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:12:43.194511 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:12:43.246322 tst emergency_mo_mt_call.py: using LAC 28632 13:12:43.372120 tst emergency_mo_mt_call.py: using RAC 72 13:12:43.487923 tst emergency_mo_mt_call.py: using CellId 28632 13:12:43.602283 tst emergency_mo_mt_call.py: using BVCI 28633 13:12:43.710912 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:12:43.721768 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:12:43.732238 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:12:43.743239 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:12:43.754377 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:12:43.765427 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:12:43.882671 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:12:44.000442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:44.485183 run create_hlr_db(pid=12314): Launched 13:12:44.612920 bus /sierra_2: Setting Powered False 13:12:45.674766 run create_hlr_db(pid=12314): Terminated: ok {rc=0} 13:12:46.165742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12316): Launched 13:12:46.489507 run osmo-hlr_10.42.42.2(pid=12317): Launched 13:12:46.653584 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:47.463119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12319): Launched 13:12:47.756436 run osmo-stp_10.42.42.5(pid=12320): Launched 13:12:47.878012 tst emergency_mo_mt_call.py: using MSISDN 7753 13:12:48.027695 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:48.553276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12322): Launched 13:12:48.844345 run osmo-msc_10.42.42.6(pid=12323): Launched 13:12:49.008325 run osmo-stp_10.42.42.5(pid=12320): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12320)] 13:12:49.133234 run osmo-stp_10.42.42.5(pid=12320): stdout: | (launched: 2022-12-10_13:12:47.703178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:49.257736 run osmo-stp_10.42.42.5(pid=12320): stderr: | [0;m[38;5;43m20221210131247871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131247871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131247872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131247872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131247873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131247873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131247873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:49.379816 run osmo-stp_10.42.42.5(pid=12320): stdout: | (launched: 2022-12-10_13:12:47.703178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:49.496067 run osmo-stp_10.42.42.5(pid=12320): stderr: | [0;m[38;5;43m20221210131247871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131247871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131247872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131247872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131247873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131247873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131247873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:49.635027 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12320): Process ended prematurely: osmo-stp_10.42.42.5(pid=12320) [trial-2375↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12320)] [trial-2375↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 13:12:49.643513 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 13:12:49.669573 run osmo-hlr_10.42.42.2(pid=12317): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12317)] 13:12:49.717404 run osmo-hlr_10.42.42.2(pid=12317): stdout: | (launched: 2022-12-10_13:12:46.419894) 13:12:49.766023 run osmo-hlr_10.42.42.2(pid=12317): stderr: | [0;m[1;31m20221210131246753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131246753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131246753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131246754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131246754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131246754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131246771 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131246801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131246802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131246802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:49.834235 run osmo-msc_10.42.42.6(pid=12323): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12323)] 13:12:49.881604 run osmo-msc_10.42.42.6(pid=12323): stdout: | (launched: 2022-12-10_13:12:48.791106) 13:12:49.930148 run osmo-msc_10.42.42.6(pid=12323): stderr: | [0;m[38;5;43m20221210131249061 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131249062 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f89a87c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131249062 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131249062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131249062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131249062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131249064 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131249064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131249064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131249064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:49.979257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12316): Terminating (SIGTERM) 13:12:50.018964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12319): Terminating (SIGTERM) 13:12:50.058679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12322): Terminating (SIGTERM) 13:12:50.098589 --- ParallelTerminationStrategy: PID 12316 died... 13:12:50.117306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12316): Terminated: ok {rc=0} 13:12:50.161171 --- ParallelTerminationStrategy: PID 12319 died... 13:12:50.179674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12319): Terminated: ok {rc=0} 13:12:50.223285 --- ParallelTerminationStrategy: PID 12322 died... 13:12:50.241622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12322): Terminated: ok {rc=0} 13:12:50.326860 bus /sierra_3: Setting Powered False 13:12:51.424425 bus /sierra_3: Setting Powered False 13:12:52.535513 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 13:12:53.618551 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:12:53.629934 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:12:53.680472 tst emergency_preemptive_call.py: using LAC 28633 13:12:53.797360 tst emergency_preemptive_call.py: using RAC 73 13:12:53.913383 tst emergency_preemptive_call.py: using CellId 28633 13:12:54.030472 tst emergency_preemptive_call.py: using BVCI 28634 13:12:54.138767 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:12:54.149686 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:12:54.160343 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:12:54.171171 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:12:54.181989 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:12:54.192695 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:12:54.309606 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:12:54.426138 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:12:54.544081 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:12:54.657590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:55.110680 run create_hlr_db(pid=12325): Launched 13:12:55.221581 bus /sierra_2: Setting Powered False 13:12:56.280291 run create_hlr_db(pid=12325): Terminated: ok {rc=0} 13:12:56.708596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12327): Launched 13:12:57.021238 run osmo-hlr_10.42.42.2(pid=12328): Launched 13:12:57.141627 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:57.677581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12330): Launched 13:12:57.990737 run osmo-stp_10.42.42.5(pid=12331): Launched 13:12:58.124772 tst emergency_preemptive_call.py: using MSISDN 7754 13:12:58.284600 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:58.844699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12333): Launched 13:12:59.156328 run osmo-msc_10.42.42.6(pid=12334): Launched 13:12:59.329903 run osmo-stp_10.42.42.5(pid=12331): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12331)] 13:12:59.461267 run osmo-stp_10.42.42.5(pid=12331): stdout: | (launched: 2022-12-10_13:12:57.933775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:59.592940 run osmo-stp_10.42.42.5(pid=12331): stderr: | [0;m[38;5;43m20221210131258126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131258126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131258126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131258127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131258127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131258127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131258127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:59.724567 run osmo-stp_10.42.42.5(pid=12331): stdout: | (launched: 2022-12-10_13:12:57.933775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:59.848650 run osmo-stp_10.42.42.5(pid=12331): stderr: | [0;m[38;5;43m20221210131258126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131258126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131258126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131258127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131258127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131258127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131258127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:59.996616 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12331): Process ended prematurely: osmo-stp_10.42.42.5(pid=12331) [trial-2375↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12331)] [trial-2375↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 13:13:00.005715 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 13:13:00.032780 run osmo-hlr_10.42.42.2(pid=12328): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12328)] 13:13:00.082746 run osmo-hlr_10.42.42.2(pid=12328): stdout: | (launched: 2022-12-10_13:12:56.964487) 13:13:00.135391 run osmo-hlr_10.42.42.2(pid=12328): stderr: | [0;m[1;31m20221210131257160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131257160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131257160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131257160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131257160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131257160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131257173 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131257181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131257181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131257181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:00.207456 run osmo-msc_10.42.42.6(pid=12334): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12334)] 13:13:00.257299 run osmo-msc_10.42.42.6(pid=12334): stdout: | (launched: 2022-12-10_13:12:59.099321) 13:13:00.308654 run osmo-msc_10.42.42.6(pid=12334): stderr: | [0;m[38;5;43m20221210131259420 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131259420 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3ed2d13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131259421 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131259421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131259421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131259421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131259423 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131259423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131259423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131259423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:00.360639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12327): Terminating (SIGTERM) 13:13:00.402116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12330): Terminating (SIGTERM) 13:13:00.443815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12333): Terminating (SIGTERM) 13:13:00.485418 --- ParallelTerminationStrategy: PID 12327 died... 13:13:00.504993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12327): Terminated: ok {rc=0} 13:13:00.550624 --- ParallelTerminationStrategy: PID 12330 died... 13:13:00.569977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12330): Terminated: ok {rc=0} 13:13:00.615541 --- ParallelTerminationStrategy: PID 12333 died... 13:13:00.634940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12333): Terminated: ok {rc=0} 13:13:00.721872 bus /sierra_9: Setting Powered False 13:13:01.823909 bus /sierra_9: Setting Powered False 13:13:02.941191 bus /sierra_8: Setting Powered False 13:13:04.040162 bus /sierra_8: Setting Powered False 13:13:05.153804 bus /sierra_3: Setting Powered False 13:13:06.250770 bus /sierra_3: Setting Powered False 13:13:07.364586 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 13:13:08.640094 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:13:08.644383 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:13:08.678421 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 13:13:08.716070 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 13:13:08.801633 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:13:08.834610 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 13:13:08.872338 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 13:13:09.461397 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 13:13:09.510419 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:09.520850 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:13:09.569305 tst cs_paging_gprs_active.py: using LAC 28634 13:13:09.688057 tst cs_paging_gprs_active.py: using RAC 74 13:13:09.806940 tst cs_paging_gprs_active.py: using CellId 28634 13:13:09.925963 tst cs_paging_gprs_active.py: using BVCI 28635 13:13:10.036933 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:10.047662 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:10.058573 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:10.069371 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:10.079862 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:10.090461 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:10.101403 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:10.111890 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:10.122803 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:13:10.240741 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:13:10.356622 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:13:10.558577 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:13:10.858427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12339): Launched 13:13:11.119341 run iperf3-srv_10.42.42.10(pid=12340): Launched 13:13:11.231825 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:13:11.432805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:13:11.734217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12341): Launched 13:13:11.995742 run iperf3-srv_10.42.42.10(pid=12342): Launched 13:13:12.108142 tst cs_paging_gprs_active.py:38: start network... 13:13:12.308318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:12.772755 run create_hlr_db(pid=12343): Launched 13:13:12.887106 bus /sierra_2: Setting Powered False 13:13:13.946811 run create_hlr_db(pid=12343): Terminated: ok {rc=0} 13:13:14.384022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12345): Launched 13:13:14.704567 run osmo-hlr_10.42.42.2(pid=12346): Launched 13:13:14.826935 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:15.375936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12348): Launched 13:13:15.695158 run osmo-stp_10.42.42.5(pid=12349): Launched 13:13:15.817065 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:13:16.489874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12351): Launched 13:13:16.617330 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:13:16.918680 run patchelf(pid=12352): Launched 13:13:17.130321 run osmo-stp_10.42.42.5(pid=12349): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12349)] 13:13:17.275851 run osmo-stp_10.42.42.5(pid=12349): stdout: | (launched: 2022-12-10_13:13:15.636682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:17.407451 run osmo-stp_10.42.42.5(pid=12349): stderr: | [0;m[38;5;43m20221210131315831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131315832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131315832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131315832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131315833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131315833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131315833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:17.537348 run osmo-stp_10.42.42.5(pid=12349): stdout: | (launched: 2022-12-10_13:13:15.636682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:17.661462 run osmo-stp_10.42.42.5(pid=12349): stderr: | [0;m[38;5;43m20221210131315831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131315832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131315832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131315832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131315833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131315833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131315833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:17.808099 run patchelf(pid=12352): Terminating (SIGINT) 13:13:17.977838 run patchelf(pid=12352): Terminated: ok {rc=0} 13:13:18.100428 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12349): Process ended prematurely: osmo-stp_10.42.42.5(pid=12349) [trial-2375↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12349)] [trial-2375↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 13:13:18.110491 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:13:18.138398 run osmo-hlr_10.42.42.2(pid=12346): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12346)] 13:13:18.186533 run osmo-hlr_10.42.42.2(pid=12346): stdout: | (launched: 2022-12-10_13:13:14.646995) 13:13:18.236130 run osmo-hlr_10.42.42.2(pid=12346): stderr: | [0;m[1;31m20221210131314844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131314844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131314844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131314844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131314844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131314844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131314855 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131314864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131314864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131314864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:18.286445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12339): Terminating (SIGTERM) 13:13:18.326539 run iperf3-srv_10.42.42.10(pid=12340): Terminating (SIGTERM) 13:13:18.366818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12341): Terminating (SIGTERM) 13:13:18.406901 run iperf3-srv_10.42.42.10(pid=12342): Terminating (SIGTERM) 13:13:18.446738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12345): Terminating (SIGTERM) 13:13:18.486811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12348): Terminating (SIGTERM) 13:13:18.526856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12351): Terminating (SIGTERM) 13:13:18.567458 --- ParallelTerminationStrategy: PID 12339 died... 13:13:18.586594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12339): Terminated: ok {rc=0} 13:13:18.631444 --- ParallelTerminationStrategy: PID 12340 died... 13:13:18.649970 run iperf3-srv_10.42.42.10(pid=12340): Terminated {rc=256} 13:13:18.694206 --- ParallelTerminationStrategy: PID 12341 died... 13:13:18.712688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12341): Terminated: ok {rc=0} 13:13:18.756747 --- ParallelTerminationStrategy: PID 12342 died... 13:13:18.775159 run iperf3-srv_10.42.42.10(pid=12342): Terminated {rc=256} 13:13:18.819270 --- ParallelTerminationStrategy: PID 12345 died... 13:13:18.837842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12345): Terminated: ok {rc=0} 13:13:18.882119 --- ParallelTerminationStrategy: PID 12348 died... 13:13:18.900651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12348): Terminated: ok {rc=0} 13:13:18.945029 --- ParallelTerminationStrategy: PID 12351 died... 13:13:18.963652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12351): Terminated: ok {rc=0} 13:13:19.050086 bus /gobi_0: Setting Powered False 13:13:20.148094 bus /gobi_0: Setting Powered False 13:13:21.260090 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 13:13:22.407200 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:22.418881 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:13:22.475936 tst iperf3.py: using LAC 28635 13:13:22.600800 tst iperf3.py: using RAC 75 13:13:22.724623 tst iperf3.py: using CellId 28635 13:13:22.847960 tst iperf3.py: using BVCI 28636 13:13:22.963310 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:22.974409 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:22.985311 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:22.996132 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:23.007004 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:23.017755 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:23.028638 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:23.039391 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:23.050374 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:13:23.166499 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:13:23.382033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:13:23.700551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12353): Launched 13:13:23.976428 run iperf3-srv_10.42.42.10(pid=12354): Launched 13:13:24.096108 tst iperf3.py:8: start network... 13:13:24.311389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:24.807147 run create_hlr_db(pid=12355): Launched 13:13:24.936090 bus /gobi_6: Setting Powered False 13:13:25.998828 run create_hlr_db(pid=12355): Terminated: ok {rc=0} 13:13:26.425506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12357): Launched 13:13:26.727123 run osmo-hlr_10.42.42.2(pid=12358): Launched 13:13:26.841938 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:27.370235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12360): Launched 13:13:27.669569 run osmo-stp_10.42.42.5(pid=12361): Launched 13:13:27.784565 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:13:28.304064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12363): Launched 13:13:28.418572 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:13:28.672089 run patchelf(pid=12364): Launched 13:13:28.839036 run osmo-stp_10.42.42.5(pid=12361): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12361)] 13:13:28.966041 run osmo-stp_10.42.42.5(pid=12361): stdout: | (launched: 2022-12-10_13:13:27.615032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:29.095124 run osmo-stp_10.42.42.5(pid=12361): stderr: | [0;m[38;5;43m20221210131327788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131327788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131327788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131327788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131327789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131327789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131327789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:29.223928 run osmo-stp_10.42.42.5(pid=12361): stdout: | (launched: 2022-12-10_13:13:27.615032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:29.347844 run osmo-stp_10.42.42.5(pid=12361): stderr: | [0;m[38;5;43m20221210131327788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131327788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131327788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131327788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131327789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131327789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131327789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:29.493989 run patchelf(pid=12364): Terminating (SIGINT) 13:13:29.663271 run patchelf(pid=12364): Terminated: ok {rc=0} 13:13:29.785204 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12361): Process ended prematurely: osmo-stp_10.42.42.5(pid=12361) [trial-2375↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12361)] [trial-2375↪gprs:trx-sysmocell5000↪iperf3.py:8] 13:13:29.794706 tst iperf3.py:8: Test FAILED (7.4 sec) 13:13:29.822275 run osmo-hlr_10.42.42.2(pid=12358): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12358)] 13:13:29.870104 run osmo-hlr_10.42.42.2(pid=12358): stdout: | (launched: 2022-12-10_13:13:26.672562) 13:13:29.919321 run osmo-hlr_10.42.42.2(pid=12358): stderr: | [0;m[1;31m20221210131326848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131326848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131326848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131326848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131326848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131326848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131326861 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131326869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131326869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131326869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:29.969152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12353): Terminating (SIGTERM) 13:13:30.009104 run iperf3-srv_10.42.42.10(pid=12354): Terminating (SIGTERM) 13:13:30.049078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12357): Terminating (SIGTERM) 13:13:30.089232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12360): Terminating (SIGTERM) 13:13:30.129169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12363): Terminating (SIGTERM) 13:13:30.169427 --- ParallelTerminationStrategy: PID 12353 died... 13:13:30.188348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12353): Terminated: ok {rc=0} 13:13:30.232930 --- ParallelTerminationStrategy: PID 12354 died... 13:13:30.251733 run iperf3-srv_10.42.42.10(pid=12354): Terminated {rc=256} 13:13:30.295708 --- ParallelTerminationStrategy: PID 12357 died... 13:13:30.314216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12357): Terminated: ok {rc=0} 13:13:30.357696 --- ParallelTerminationStrategy: PID 12360 died... 13:13:30.376113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12360): Terminated: ok {rc=0} 13:13:30.420132 --- ParallelTerminationStrategy: PID 12363 died... 13:13:30.438565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12363): Terminated: ok {rc=0} 13:13:30.523724 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 13:13:31.667534 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:31.679606 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:13:31.732482 tst iperf3m4.py: using LAC 28636 13:13:31.855535 tst iperf3m4.py: using RAC 76 13:13:32.011820 tst iperf3m4.py: using CellId 28636 13:13:32.131840 tst iperf3m4.py: using BVCI 28637 13:13:32.243448 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:32.255005 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:32.266470 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:32.278954 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:32.293198 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:32.306501 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:32.317255 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:32.328010 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:32.338935 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:13:32.458141 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:13:32.579793 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:13:32.695872 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:13:32.810711 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:13:33.010870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:13:33.310459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12365): Launched 13:13:33.571387 run iperf3-srv_10.42.42.10(pid=12366): Launched 13:13:33.690623 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:13:33.890365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:13:34.189715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12367): Launched 13:13:34.450064 run iperf3-srv_10.42.42.10(pid=12368): Launched 13:13:34.562193 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:13:34.762399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:13:35.061704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12369): Launched 13:13:35.321152 run iperf3-srv_10.42.42.10(pid=12370): Launched 13:13:35.433129 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:13:35.633148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:13:35.932492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12371): Launched 13:13:36.192332 run iperf3-srv_10.42.42.10(pid=12372): Launched 13:13:36.304560 tst iperf3m4.py:8: start network... 13:13:36.504725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:36.968049 run create_hlr_db(pid=12373): Launched 13:13:37.083122 bus /gobi_6: Setting Powered False 13:13:38.142447 run create_hlr_db(pid=12373): Terminated: ok {rc=0} 13:13:38.557570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12375): Launched 13:13:38.857491 run osmo-hlr_10.42.42.2(pid=12376): Launched 13:13:38.972010 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:39.502290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12378): Launched 13:13:39.801473 run osmo-stp_10.42.42.5(pid=12379): Launched 13:13:39.917685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:13:40.439589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12381): Launched 13:13:40.554130 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:13:40.807705 run patchelf(pid=12382): Launched 13:13:40.974247 run osmo-stp_10.42.42.5(pid=12379): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12379)] 13:13:41.101386 run osmo-stp_10.42.42.5(pid=12379): stdout: | (launched: 2022-12-10_13:13:39.746977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:41.230072 run osmo-stp_10.42.42.5(pid=12379): stderr: | [0;m[38;5;43m20221210131339917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131339917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131339918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131339918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131339919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131339919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131339919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:41.358697 run osmo-stp_10.42.42.5(pid=12379): stdout: | (launched: 2022-12-10_13:13:39.746977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:41.482609 run osmo-stp_10.42.42.5(pid=12379): stderr: | [0;m[38;5;43m20221210131339917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131339917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131339918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131339918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131339919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131339919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131339919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:41.628691 run patchelf(pid=12382): Terminating (SIGINT) 13:13:41.797526 run patchelf(pid=12382): Terminated: ok {rc=0} 13:13:41.919492 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12379): Process ended prematurely: osmo-stp_10.42.42.5(pid=12379) [trial-2375↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12379)] [trial-2375↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 13:13:41.929241 tst iperf3m4.py:8: Test FAILED (10.3 sec) 13:13:41.956916 run osmo-hlr_10.42.42.2(pid=12376): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12376)] 13:13:42.005078 run osmo-hlr_10.42.42.2(pid=12376): stdout: | (launched: 2022-12-10_13:13:38.802663) 13:13:42.054258 run osmo-hlr_10.42.42.2(pid=12376): stderr: | [0;m[1;31m20221210131338981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131338981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131338981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131338981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131338981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131338981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131338993 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131339001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131339001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131339001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:42.104293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12365): Terminating (SIGTERM) 13:13:42.144102 run iperf3-srv_10.42.42.10(pid=12366): Terminating (SIGTERM) 13:13:42.183707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12367): Terminating (SIGTERM) 13:13:42.223507 run iperf3-srv_10.42.42.10(pid=12368): Terminating (SIGTERM) 13:13:42.263069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12369): Terminating (SIGTERM) 13:13:42.302783 run iperf3-srv_10.42.42.10(pid=12370): Terminating (SIGTERM) 13:13:42.342330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12371): Terminating (SIGTERM) 13:13:42.383230 run iperf3-srv_10.42.42.10(pid=12372): Terminating (SIGTERM) 13:13:42.422561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12375): Terminating (SIGTERM) 13:13:42.461915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12378): Terminating (SIGTERM) 13:13:42.501361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12381): Terminating (SIGTERM) 13:13:42.541509 --- ParallelTerminationStrategy: PID 12365 died... 13:13:42.560170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12365): Terminated: ok {rc=0} 13:13:42.604527 --- ParallelTerminationStrategy: PID 12366 died... 13:13:42.623010 run iperf3-srv_10.42.42.10(pid=12366): Terminated {rc=256} 13:13:42.666361 --- ParallelTerminationStrategy: PID 12367 died... 13:13:42.684721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12367): Terminated: ok {rc=0} 13:13:42.728313 --- ParallelTerminationStrategy: PID 12368 died... 13:13:42.746706 run iperf3-srv_10.42.42.10(pid=12368): Terminated {rc=256} 13:13:42.790133 --- ParallelTerminationStrategy: PID 12369 died... 13:13:42.808523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12369): Terminated: ok {rc=0} 13:13:42.852209 --- ParallelTerminationStrategy: PID 12370 died... 13:13:42.870581 run iperf3-srv_10.42.42.10(pid=12370): Terminated {rc=256} 13:13:42.914069 --- ParallelTerminationStrategy: PID 12371 died... 13:13:42.932395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12371): Terminated: ok {rc=0} 13:13:42.975810 --- ParallelTerminationStrategy: PID 12372 died... 13:13:42.994284 run iperf3-srv_10.42.42.10(pid=12372): Terminated {rc=256} 13:13:43.037900 --- ParallelTerminationStrategy: PID 12375 died... 13:13:43.056130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12375): Terminated: ok {rc=0} 13:13:43.100202 --- ParallelTerminationStrategy: PID 12378 died... 13:13:43.118815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12378): Terminated: ok {rc=0} 13:13:43.162435 --- ParallelTerminationStrategy: PID 12381 died... 13:13:43.180666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12381): Terminated: ok {rc=0} 13:13:43.263985 bus /gobi_4: Setting Powered False 13:13:44.361603 bus /gobi_4: Setting Powered False 13:13:45.478890 bus /gobi_1: Setting Powered False 13:13:46.575814 bus /gobi_1: Setting Powered False 13:13:47.690499 bus /gobi_0: Setting Powered False 13:13:48.788575 bus /gobi_0: Setting Powered False 13:13:49.905101 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 13:13:51.008404 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:51.020142 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:13:51.072045 tst ping.py: using LAC 28637 13:13:51.196806 tst ping.py: using RAC 77 13:13:51.319672 tst ping.py: using CellId 28637 13:13:51.443297 tst ping.py: using BVCI 28638 13:13:51.557458 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:51.568648 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:51.579690 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:51.591061 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:51.602376 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:51.613717 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:51.625204 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:51.636463 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:13:51.754452 tst ping.py:19: start network... 13:13:51.964407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:52.447291 run create_hlr_db(pid=12383): Launched 13:13:52.574087 bus /gobi_6: Setting Powered False 13:13:53.636409 run create_hlr_db(pid=12383): Terminated: ok {rc=0} 13:13:54.053890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12385): Launched 13:13:54.349724 run osmo-hlr_10.42.42.2(pid=12386): Launched 13:13:54.469982 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:55.012903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12388): Launched 13:13:55.324293 run osmo-stp_10.42.42.5(pid=12389): Launched 13:13:55.442321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:13:55.981089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12391): Launched 13:13:56.100708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:13:56.364738 run patchelf(pid=12392): Launched 13:13:56.539055 run osmo-stp_10.42.42.5(pid=12389): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12389)] 13:13:56.671827 run osmo-stp_10.42.42.5(pid=12389): stdout: | (launched: 2022-12-10_13:13:55.267457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:56.806234 run osmo-stp_10.42.42.5(pid=12389): stderr: | [0;m[38;5;43m20221210131355458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131355458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131355458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131355459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131355461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131355461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131355461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:56.941098 run osmo-stp_10.42.42.5(pid=12389): stdout: | (launched: 2022-12-10_13:13:55.267457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:57.069981 run osmo-stp_10.42.42.5(pid=12389): stderr: | [0;m[38;5;43m20221210131355458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131355458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131355458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131355459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131355461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131355461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131355461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:57.222889 run patchelf(pid=12392): Terminating (SIGINT) 13:13:57.398712 run patchelf(pid=12392): Terminated: ok {rc=0} 13:13:57.525589 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12389): Process ended prematurely: osmo-stp_10.42.42.5(pid=12389) [trial-2375↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12389)] [trial-2375↪gprs:trx-sysmocell5000↪ping.py:22] 13:13:57.535234 tst ping.py:22: Test FAILED (6.5 sec) 13:13:57.563118 run osmo-hlr_10.42.42.2(pid=12386): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12386)] 13:13:57.612786 run osmo-hlr_10.42.42.2(pid=12386): stdout: | (launched: 2022-12-10_13:13:54.292458) 13:13:57.664531 run osmo-hlr_10.42.42.2(pid=12386): stderr: | [0;m[1;31m20221210131354490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131354490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131354490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131354490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131354491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131354491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131354503 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131354512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131354512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131354512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:57.716515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12385): Terminating (SIGTERM) 13:13:57.758381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12388): Terminating (SIGTERM) 13:13:57.800185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12391): Terminating (SIGTERM) 13:13:57.842666 --- ParallelTerminationStrategy: PID 12385 died... 13:13:57.862560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12385): Terminated: ok {rc=0} 13:13:57.908804 --- ParallelTerminationStrategy: PID 12388 died... 13:13:57.928418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12388): Terminated: ok {rc=0} 13:13:57.974362 --- ParallelTerminationStrategy: PID 12391 died... 13:13:57.993826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12391): Terminated: ok {rc=0} 13:13:58.080814 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 13:13:59.167961 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:59.179253 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:13:59.229443 tst ping_idle_ping.py: using LAC 28638 13:13:59.345934 tst ping_idle_ping.py: using RAC 78 13:13:59.463469 tst ping_idle_ping.py: using CellId 28638 13:13:59.578951 tst ping_idle_ping.py: using BVCI 28639 13:13:59.685702 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:59.696259 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:59.706714 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:59.717463 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:59.728048 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:59.738788 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:59.749659 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:13:59.760245 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:13:59.873632 tst ping_idle_ping.py:24: start network... 13:14:00.070691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:00.528757 run create_hlr_db(pid=12393): Launched 13:14:00.641067 bus /gobi_6: Setting Powered False 13:14:01.714912 run create_hlr_db(pid=12393): Terminated: ok {rc=0} 13:14:02.185913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12395): Launched 13:14:02.486029 run osmo-hlr_10.42.42.2(pid=12396): Launched 13:14:02.599899 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:03.121106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12398): Launched 13:14:03.413539 run osmo-stp_10.42.42.5(pid=12399): Launched 13:14:03.526953 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:14:04.036188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12401): Launched 13:14:04.148439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:14:04.396312 run patchelf(pid=12402): Launched 13:14:04.559727 run osmo-stp_10.42.42.5(pid=12399): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12399)] 13:14:04.684461 run osmo-stp_10.42.42.5(pid=12399): stdout: | (launched: 2022-12-10_13:14:03.359820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:04.810564 run osmo-stp_10.42.42.5(pid=12399): stderr: | [0;m[38;5;43m20221210131403529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131403529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131403529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131403530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131403530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131403530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131403530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:04.937379 run osmo-stp_10.42.42.5(pid=12399): stdout: | (launched: 2022-12-10_13:14:03.359820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:05.058705 run osmo-stp_10.42.42.5(pid=12399): stderr: | [0;m[38;5;43m20221210131403529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131403529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131403529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131403530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131403530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131403530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131403530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:05.202228 run patchelf(pid=12402): Terminating (SIGINT) 13:14:05.367860 run patchelf(pid=12402): Terminated: ok {rc=0} 13:14:05.487300 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12399): Process ended prematurely: osmo-stp_10.42.42.5(pid=12399) [trial-2375↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12399)] [trial-2375↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 13:14:05.496091 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 13:14:05.522613 run osmo-hlr_10.42.42.2(pid=12396): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12396)] 13:14:05.570035 run osmo-hlr_10.42.42.2(pid=12396): stdout: | (launched: 2022-12-10_13:14:02.431925) 13:14:05.618920 run osmo-hlr_10.42.42.2(pid=12396): stderr: | [0;m[1;31m20221210131402607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131402607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131402607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131402607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131402607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131402607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131402619 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131402629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131402629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131402629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:05.667829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12395): Terminating (SIGTERM) 13:14:05.706829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12398): Terminating (SIGTERM) 13:14:05.745774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12401): Terminating (SIGTERM) 13:14:05.784939 --- ParallelTerminationStrategy: PID 12395 died... 13:14:05.803790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12395): Terminated: ok {rc=0} 13:14:05.847160 --- ParallelTerminationStrategy: PID 12398 died... 13:14:05.865297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12398): Terminated: ok {rc=0} 13:14:05.908917 --- ParallelTerminationStrategy: PID 12401 died... 13:14:05.927133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12401): Terminated: ok {rc=0} 13:14:06.011306 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 13:14:07.320802 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:14:07.326635 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:14:07.360818 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:14:07.399644 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:14:07.486328 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:14:07.520044 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:14:07.559327 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:14:08.150382 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:14:08.199983 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:08.210935 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:14:08.260882 tst cs_paging_gprs_active.py: using LAC 28639 13:14:08.381227 tst cs_paging_gprs_active.py: using RAC 79 13:14:08.499436 tst cs_paging_gprs_active.py: using CellId 28639 13:14:08.626451 tst cs_paging_gprs_active.py: using BVCI 28640 13:14:08.742970 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:08.754279 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:08.765304 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:08.776307 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:08.787262 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:08.798429 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:08.809536 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:08.820369 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:08.831477 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:14:08.946717 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:14:09.063103 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:14:09.264418 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:14:09.564459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12407): Launched 13:14:09.826432 run iperf3-srv_10.42.42.10(pid=12408): Launched 13:14:09.939178 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:14:10.139394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:14:10.440078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12409): Launched 13:14:10.701596 run iperf3-srv_10.42.42.10(pid=12410): Launched 13:14:10.814829 tst cs_paging_gprs_active.py:38: start network... 13:14:11.017316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:11.484315 run create_hlr_db(pid=12411): Launched 13:14:11.599395 bus /gobi_6: Setting Powered False 13:14:12.658826 run create_hlr_db(pid=12411): Terminated: ok {rc=0} 13:14:13.096020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12414): Launched 13:14:13.417165 run osmo-hlr_10.42.42.2(pid=12415): Launched 13:14:13.542107 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:14.097316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12417): Launched 13:14:14.417751 run osmo-stp_10.42.42.5(pid=12418): Launched 13:14:14.540006 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:14:15.094326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12420): Launched 13:14:15.216658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:14:15.486132 run patchelf(pid=12421): Launched 13:14:15.663234 run osmo-stp_10.42.42.5(pid=12418): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12418)] 13:14:15.798289 run osmo-stp_10.42.42.5(pid=12418): stdout: | (launched: 2022-12-10_13:14:14.359578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:15.941285 run osmo-stp_10.42.42.5(pid=12418): stderr: | [0;m[38;5;43m20221210131414550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131414550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131414550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131414551 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131414553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131414553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131414553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:16.074457 run osmo-stp_10.42.42.5(pid=12418): stdout: | (launched: 2022-12-10_13:14:14.359578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:16.204623 run osmo-stp_10.42.42.5(pid=12418): stderr: | [0;m[38;5;43m20221210131414550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131414550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131414550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131414551 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131414553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131414553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131414553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:16.356424 run patchelf(pid=12421): Terminating (SIGINT) 13:14:16.532092 run patchelf(pid=12421): Terminated: ok {rc=0} 13:14:16.657900 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12418): Process ended prematurely: osmo-stp_10.42.42.5(pid=12418) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12418)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:14:16.669039 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:14:16.701114 run osmo-hlr_10.42.42.2(pid=12415): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12415)] 13:14:16.751161 run osmo-hlr_10.42.42.2(pid=12415): stdout: | (launched: 2022-12-10_13:14:13.359062) 13:14:16.803533 run osmo-hlr_10.42.42.2(pid=12415): stderr: | [0;m[1;31m20221210131413554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131413554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131413555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131413555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131413555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131413555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131413566 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131413575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131413575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131413575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:16.856055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12407): Terminating (SIGTERM) 13:14:16.899337 run iperf3-srv_10.42.42.10(pid=12408): Terminating (SIGTERM) 13:14:16.943332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12409): Terminating (SIGTERM) 13:14:16.985480 run iperf3-srv_10.42.42.10(pid=12410): Terminating (SIGTERM) 13:14:17.027928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12414): Terminating (SIGTERM) 13:14:17.070307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12417): Terminating (SIGTERM) 13:14:17.114968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12420): Terminating (SIGTERM) 13:14:17.158983 --- ParallelTerminationStrategy: PID 12407 died... 13:14:17.178793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12407): Terminated: ok {rc=0} 13:14:17.227328 --- ParallelTerminationStrategy: PID 12408 died... 13:14:17.247163 run iperf3-srv_10.42.42.10(pid=12408): Terminated {rc=256} 13:14:17.292260 --- ParallelTerminationStrategy: PID 12409 died... 13:14:17.310717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12409): Terminated: ok {rc=0} 13:14:17.355577 --- ParallelTerminationStrategy: PID 12410 died... 13:14:17.374009 run iperf3-srv_10.42.42.10(pid=12410): Terminated {rc=256} 13:14:17.418805 --- ParallelTerminationStrategy: PID 12414 died... 13:14:17.437554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12414): Terminated: ok {rc=0} 13:14:17.482462 --- ParallelTerminationStrategy: PID 12417 died... 13:14:17.500728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12417): Terminated: ok {rc=0} 13:14:17.545527 --- ParallelTerminationStrategy: PID 12420 died... 13:14:17.563797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12420): Terminated: ok {rc=0} 13:14:17.649997 bus /gobi_0: Setting Powered False 13:14:18.749481 bus /gobi_0: Setting Powered False 13:14:19.865064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:14:21.009515 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:21.021042 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:14:21.078981 tst iperf3.py: using LAC 28640 13:14:21.197375 tst iperf3.py: using RAC 80 13:14:21.314014 tst iperf3.py: using CellId 28640 13:14:21.430410 tst iperf3.py: using BVCI 28641 13:14:21.541843 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:21.552617 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:21.563754 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:21.574607 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:21.585494 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:21.596129 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:21.606982 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:21.617760 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:21.628561 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:14:21.747953 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:14:21.963049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:14:22.282881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12422): Launched 13:14:22.559420 run iperf3-srv_10.42.42.10(pid=12423): Launched 13:14:22.678775 tst iperf3.py:8: start network... 13:14:22.893311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:23.387365 run create_hlr_db(pid=12424): Launched 13:14:23.518080 bus /gobi_6: Setting Powered False 13:14:24.580689 run create_hlr_db(pid=12424): Terminated: ok {rc=0} 13:14:25.005411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12426): Launched 13:14:25.305522 run osmo-hlr_10.42.42.2(pid=12427): Launched 13:14:25.421307 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:25.938984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12429): Launched 13:14:26.236375 run osmo-stp_10.42.42.5(pid=12430): Launched 13:14:26.350475 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:14:26.867092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12432): Launched 13:14:26.980884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:14:27.233519 run patchelf(pid=12433): Launched 13:14:27.400668 run osmo-stp_10.42.42.5(pid=12430): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12430)] 13:14:27.527428 run osmo-stp_10.42.42.5(pid=12430): stdout: | (launched: 2022-12-10_13:14:26.182093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:27.656006 run osmo-stp_10.42.42.5(pid=12430): stderr: | [0;m[38;5;43m20221210131426354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131426354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131426354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131426355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131426355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131426355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131426355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:27.784574 run osmo-stp_10.42.42.5(pid=12430): stdout: | (launched: 2022-12-10_13:14:26.182093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:27.907831 run osmo-stp_10.42.42.5(pid=12430): stderr: | [0;m[38;5;43m20221210131426354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131426354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131426354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131426355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131426355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131426355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131426355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:28.053585 run patchelf(pid=12433): Terminating (SIGINT) 13:14:28.222332 run patchelf(pid=12433): Terminated: ok {rc=0} 13:14:28.344098 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12430): Process ended prematurely: osmo-stp_10.42.42.5(pid=12430) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12430)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 13:14:28.353484 tst iperf3.py:8: Test FAILED (7.4 sec) 13:14:28.380378 run osmo-hlr_10.42.42.2(pid=12427): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12427)] 13:14:28.428313 run osmo-hlr_10.42.42.2(pid=12427): stdout: | (launched: 2022-12-10_13:14:25.251182) 13:14:28.477506 run osmo-hlr_10.42.42.2(pid=12427): stderr: | [0;m[1;31m20221210131425425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131425425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131425425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131425425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131425425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131425425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131425437 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131425445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131425445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131425445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:28.527412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12422): Terminating (SIGTERM) 13:14:28.567293 run iperf3-srv_10.42.42.10(pid=12423): Terminating (SIGTERM) 13:14:28.607001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12426): Terminating (SIGTERM) 13:14:28.646583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12429): Terminating (SIGTERM) 13:14:28.686165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12432): Terminating (SIGTERM) 13:14:28.725988 --- ParallelTerminationStrategy: PID 12422 died... 13:14:28.744851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12422): Terminated: ok {rc=0} 13:14:28.789208 --- ParallelTerminationStrategy: PID 12423 died... 13:14:28.807500 run iperf3-srv_10.42.42.10(pid=12423): Terminated {rc=256} 13:14:28.851699 --- ParallelTerminationStrategy: PID 12426 died... 13:14:28.869939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12426): Terminated: ok {rc=0} 13:14:28.913360 --- ParallelTerminationStrategy: PID 12429 died... 13:14:28.931790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12429): Terminated: ok {rc=0} 13:14:28.975363 --- ParallelTerminationStrategy: PID 12432 died... 13:14:28.993754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12432): Terminated: ok {rc=0} 13:14:29.078548 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:14:30.223258 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:30.234788 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:14:30.289986 tst iperf3m4.py: using LAC 28641 13:14:30.409362 tst iperf3m4.py: using RAC 81 13:14:30.525928 tst iperf3m4.py: using CellId 28641 13:14:30.643286 tst iperf3m4.py: using BVCI 28642 13:14:30.752552 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:30.763467 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:30.774122 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:30.784939 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:30.795747 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:30.806588 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:30.817575 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:30.828539 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:30.840095 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:14:30.967304 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:14:31.099115 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:14:31.243410 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:14:31.371813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:14:31.600220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:14:31.944706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12434): Launched 13:14:32.246312 run iperf3-srv_10.42.42.10(pid=12435): Launched 13:14:32.359953 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:14:32.560508 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:14:32.859625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12436): Launched 13:14:33.118935 run iperf3-srv_10.42.42.10(pid=12437): Launched 13:14:33.232313 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:14:33.433381 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:14:33.732684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12438): Launched 13:14:33.992931 run iperf3-srv_10.42.42.10(pid=12439): Launched 13:14:34.105205 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:14:34.305978 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:14:34.605998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12440): Launched 13:14:34.866208 run iperf3-srv_10.42.42.10(pid=12441): Launched 13:14:34.978708 tst iperf3m4.py:8: start network... 13:14:35.180189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:35.643480 run create_hlr_db(pid=12442): Launched 13:14:35.757638 bus /gobi_6: Setting Powered False 13:14:36.817184 run create_hlr_db(pid=12442): Terminated: ok {rc=0} 13:14:37.233283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12444): Launched 13:14:37.532130 run osmo-hlr_10.42.42.2(pid=12445): Launched 13:14:37.647286 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:38.163241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12447): Launched 13:14:38.461128 run osmo-stp_10.42.42.5(pid=12448): Launched 13:14:38.575361 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:14:39.092420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12450): Launched 13:14:39.207597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:14:39.460514 run patchelf(pid=12451): Launched 13:14:39.626677 run osmo-stp_10.42.42.5(pid=12448): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12448)] 13:14:39.752772 run osmo-stp_10.42.42.5(pid=12448): stdout: | (launched: 2022-12-10_13:14:38.406525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:39.880668 run osmo-stp_10.42.42.5(pid=12448): stderr: | [0;m[38;5;43m20221210131438578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131438578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131438579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131438579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131438580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131438580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131438580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:40.009358 run osmo-stp_10.42.42.5(pid=12448): stdout: | (launched: 2022-12-10_13:14:38.406525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:40.132117 run osmo-stp_10.42.42.5(pid=12448): stderr: | [0;m[38;5;43m20221210131438578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131438578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131438579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131438579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131438580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131438580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131438580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:40.277909 run patchelf(pid=12451): Terminating (SIGINT) 13:14:40.445799 run patchelf(pid=12451): Terminated: ok {rc=0} 13:14:40.566851 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12448): Process ended prematurely: osmo-stp_10.42.42.5(pid=12448) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12448)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 13:14:40.576103 tst iperf3m4.py:8: Test FAILED (10.4 sec) 13:14:40.603525 run osmo-hlr_10.42.42.2(pid=12445): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12445)] 13:14:40.651017 run osmo-hlr_10.42.42.2(pid=12445): stdout: | (launched: 2022-12-10_13:14:37.477276) 13:14:40.700343 run osmo-hlr_10.42.42.2(pid=12445): stderr: | [0;m[1;31m20221210131437652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131437652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131437652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131437652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131437652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131437652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131437667 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131437675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131437676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131437676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:40.750288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12434): Terminating (SIGTERM) 13:14:40.790176 run iperf3-srv_10.42.42.10(pid=12435): Terminating (SIGTERM) 13:14:40.829720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12436): Terminating (SIGTERM) 13:14:40.869342 run iperf3-srv_10.42.42.10(pid=12437): Terminating (SIGTERM) 13:14:40.908671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12438): Terminating (SIGTERM) 13:14:40.948252 run iperf3-srv_10.42.42.10(pid=12439): Terminating (SIGTERM) 13:14:40.987835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12440): Terminating (SIGTERM) 13:14:41.027754 run iperf3-srv_10.42.42.10(pid=12441): Terminating (SIGTERM) 13:14:41.067126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12444): Terminating (SIGTERM) 13:14:41.106760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12447): Terminating (SIGTERM) 13:14:41.146199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12450): Terminating (SIGTERM) 13:14:41.186181 --- ParallelTerminationStrategy: PID 12434 died... 13:14:41.205281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12434): Terminated: ok {rc=0} 13:14:41.249984 --- ParallelTerminationStrategy: PID 12435 died... 13:14:41.268259 run iperf3-srv_10.42.42.10(pid=12435): Terminated {rc=256} 13:14:41.311970 --- ParallelTerminationStrategy: PID 12436 died... 13:14:41.330206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12436): Terminated: ok {rc=0} 13:14:41.373782 --- ParallelTerminationStrategy: PID 12437 died... 13:14:41.391995 run iperf3-srv_10.42.42.10(pid=12437): Terminated {rc=256} 13:14:41.435456 --- ParallelTerminationStrategy: PID 12438 died... 13:14:41.453701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12438): Terminated: ok {rc=0} 13:14:41.497066 --- ParallelTerminationStrategy: PID 12439 died... 13:14:41.515287 run iperf3-srv_10.42.42.10(pid=12439): Terminated {rc=256} 13:14:41.559224 --- ParallelTerminationStrategy: PID 12440 died... 13:14:41.577465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12440): Terminated: ok {rc=0} 13:14:41.621149 --- ParallelTerminationStrategy: PID 12441 died... 13:14:41.639320 run iperf3-srv_10.42.42.10(pid=12441): Terminated {rc=256} 13:14:41.682679 --- ParallelTerminationStrategy: PID 12444 died... 13:14:41.700811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12444): Terminated: ok {rc=0} 13:14:41.744317 --- ParallelTerminationStrategy: PID 12447 died... 13:14:41.762641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12447): Terminated: ok {rc=0} 13:14:41.806934 --- ParallelTerminationStrategy: PID 12450 died... 13:14:41.825181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12450): Terminated: ok {rc=0} 13:14:41.908113 bus /gobi_4: Setting Powered False 13:14:43.002168 bus /gobi_4: Setting Powered False 13:14:44.115772 bus /gobi_1: Setting Powered False 13:14:45.213727 bus /gobi_1: Setting Powered False 13:14:46.331164 bus /gobi_0: Setting Powered False 13:14:47.430249 bus /gobi_0: Setting Powered False 13:14:48.545565 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 13:14:49.648234 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:49.660331 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:14:49.713433 tst ping.py: using LAC 28642 13:14:49.838408 tst ping.py: using RAC 82 13:14:49.965809 tst ping.py: using CellId 28642 13:14:50.082251 tst ping.py: using BVCI 28643 13:14:50.190493 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:50.201482 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:50.212288 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:50.223203 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:50.234027 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:50.244755 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:50.255888 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:50.266708 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:14:50.383423 tst ping.py:19: start network... 13:14:50.593293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:51.076266 run create_hlr_db(pid=12452): Launched 13:14:51.204507 bus /gobi_6: Setting Powered False 13:14:52.266574 run create_hlr_db(pid=12452): Terminated: ok {rc=0} 13:14:52.685647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12454): Launched 13:14:52.979333 run osmo-hlr_10.42.42.2(pid=12455): Launched 13:14:53.090813 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:53.598864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12457): Launched 13:14:53.891385 run osmo-stp_10.42.42.5(pid=12458): Launched 13:14:54.003026 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:14:54.540783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12460): Launched 13:14:54.660222 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:14:54.924233 run patchelf(pid=12461): Launched 13:14:55.098833 run osmo-stp_10.42.42.5(pid=12458): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12458)] 13:14:55.232398 run osmo-stp_10.42.42.5(pid=12458): stdout: | (launched: 2022-12-10_13:14:53.838071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:55.367250 run osmo-stp_10.42.42.5(pid=12458): stderr: | [0;m[38;5;43m20221210131454006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131454006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131454007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131454007 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131454007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131454008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131454008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:55.501536 run osmo-stp_10.42.42.5(pid=12458): stdout: | (launched: 2022-12-10_13:14:53.838071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:55.630468 run osmo-stp_10.42.42.5(pid=12458): stderr: | [0;m[38;5;43m20221210131454006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131454006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131454007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131454007 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131454007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131454008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131454008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:55.782945 run patchelf(pid=12461): Terminating (SIGINT) 13:14:55.959401 run patchelf(pid=12461): Terminated: ok {rc=0} 13:14:56.086181 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12458): Process ended prematurely: osmo-stp_10.42.42.5(pid=12458) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12458)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 13:14:56.095490 tst ping.py:22: Test FAILED (6.4 sec) 13:14:56.122988 run osmo-hlr_10.42.42.2(pid=12455): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12455)] 13:14:56.172515 run osmo-hlr_10.42.42.2(pid=12455): stdout: | (launched: 2022-12-10_13:14:52.925322) 13:14:56.223816 run osmo-hlr_10.42.42.2(pid=12455): stderr: | [0;m[1;31m20221210131453103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131453103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131453103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131453103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131453103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131453103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131453115 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131453123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131453124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131453124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:56.275255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12454): Terminating (SIGTERM) 13:14:56.316660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12457): Terminating (SIGTERM) 13:14:56.358112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12460): Terminating (SIGTERM) 13:14:56.399682 --- ParallelTerminationStrategy: PID 12454 died... 13:14:56.419400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12454): Terminated: ok {rc=0} 13:14:56.465231 --- ParallelTerminationStrategy: PID 12457 died... 13:14:56.484246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12457): Terminated: ok {rc=0} 13:14:56.529794 --- ParallelTerminationStrategy: PID 12460 died... 13:14:56.549135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12460): Terminated: ok {rc=0} 13:14:56.636241 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:14:57.724130 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:57.736500 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:14:57.790710 tst ping_idle_ping.py: using LAC 28643 13:14:57.915758 tst ping_idle_ping.py: using RAC 83 13:14:58.039198 tst ping_idle_ping.py: using CellId 28643 13:14:58.162567 tst ping_idle_ping.py: using BVCI 28644 13:14:58.278813 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:58.290229 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:58.301424 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:58.312565 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:58.323666 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:58.334837 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:58.346168 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:14:58.357271 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:14:58.474234 tst ping_idle_ping.py:24: start network... 13:14:58.685472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:59.173766 run create_hlr_db(pid=12462): Launched 13:14:59.302277 bus /gobi_6: Setting Powered False 13:15:00.365055 run create_hlr_db(pid=12462): Terminated: ok {rc=0} 13:15:00.786925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12464): Launched 13:15:01.134512 run osmo-hlr_10.42.42.2(pid=12465): Launched 13:15:01.393245 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:02.063021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12470): Launched 13:15:02.398480 run osmo-stp_10.42.42.5(pid=12471): Launched 13:15:02.511289 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:15:03.019773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12473): Launched 13:15:03.132909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:15:03.383411 run patchelf(pid=12474): Launched 13:15:03.547770 run osmo-stp_10.42.42.5(pid=12471): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12471)] 13:15:03.672931 run osmo-stp_10.42.42.5(pid=12471): stdout: | (launched: 2022-12-10_13:15:02.333809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:03.799789 run osmo-stp_10.42.42.5(pid=12471): stderr: | [0;m[38;5;43m20221210131502514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131502514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131502514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131502514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131502515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131502515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131502515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:03.926530 run osmo-stp_10.42.42.5(pid=12471): stdout: | (launched: 2022-12-10_13:15:02.333809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:04.047912 run osmo-stp_10.42.42.5(pid=12471): stderr: | [0;m[38;5;43m20221210131502514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131502514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131502514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131502514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131502515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131502515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131502515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:04.191806 run patchelf(pid=12474): Terminating (SIGINT) 13:15:04.358757 run patchelf(pid=12474): Terminated: ok {rc=0} 13:15:04.478675 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12471): Process ended prematurely: osmo-stp_10.42.42.5(pid=12471) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12471)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 13:15:04.487367 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 13:15:04.514090 run osmo-hlr_10.42.42.2(pid=12465): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12465)] 13:15:04.561398 run osmo-hlr_10.42.42.2(pid=12465): stdout: | (launched: 2022-12-10_13:15:01.070295) 13:15:04.610254 run osmo-hlr_10.42.42.2(pid=12465): stderr: | [0;m[1;31m20221210131501367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131501367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131501367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131501367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131501368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131501368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131501387 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131501404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131501404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131501404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:04.659371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12464): Terminating (SIGTERM) 13:15:04.698609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12470): Terminating (SIGTERM) 13:15:04.737973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12473): Terminating (SIGTERM) 13:15:04.777553 --- ParallelTerminationStrategy: PID 12464 died... 13:15:04.796160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12464): Terminated: ok {rc=0} 13:15:04.840605 --- ParallelTerminationStrategy: PID 12470 died... 13:15:04.859001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12470): Terminated: ok {rc=0} 13:15:04.902869 --- ParallelTerminationStrategy: PID 12473 died... 13:15:04.921264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12473): Terminated: ok {rc=0} 13:15:05.006706 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:15:06.320326 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:15:06.326696 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:15:06.361618 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:15:06.400804 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:15:06.490840 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:15:06.525560 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:15:06.563174 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:15:07.159134 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:15:07.212406 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:07.223843 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:15:07.294688 tst cs_paging_gprs_active.py: using LAC 28644 13:15:07.422180 tst cs_paging_gprs_active.py: using RAC 84 13:15:07.547816 tst cs_paging_gprs_active.py: using CellId 28644 13:15:07.673013 tst cs_paging_gprs_active.py: using BVCI 28645 13:15:07.789411 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:07.800620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:07.811706 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:07.822909 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:07.833986 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:07.844937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:07.856066 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:07.867098 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:07.878263 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:15:07.992752 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:15:08.110340 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:15:08.312086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:08.613699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12478): Launched 13:15:08.874880 run iperf3-srv_10.42.42.10(pid=12479): Launched 13:15:08.987473 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:15:09.188014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:09.490076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12480): Launched 13:15:09.750652 run iperf3-srv_10.42.42.10(pid=12481): Launched 13:15:09.863062 tst cs_paging_gprs_active.py:38: start network... 13:15:10.063003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:10.527179 run create_hlr_db(pid=12482): Launched 13:15:10.642252 bus /gobi_6: Setting Powered False 13:15:11.702373 run create_hlr_db(pid=12482): Terminated: ok {rc=0} 13:15:12.139600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12484): Launched 13:15:12.459721 run osmo-hlr_10.42.42.2(pid=12485): Launched 13:15:12.582976 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:13.139614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12487): Launched 13:15:13.458681 run osmo-stp_10.42.42.5(pid=12488): Launched 13:15:13.581272 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:15:14.133220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12490): Launched 13:15:14.255596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:15:14.525408 run patchelf(pid=12491): Launched 13:15:14.704307 run osmo-stp_10.42.42.5(pid=12488): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12488)] 13:15:14.839569 run osmo-stp_10.42.42.5(pid=12488): stdout: | (launched: 2022-12-10_13:15:13.401042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:14.975897 run osmo-stp_10.42.42.5(pid=12488): stderr: | [0;m[38;5;43m20221210131513593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131513594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131513594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131513594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131513595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131513595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131513595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:15.112308 run osmo-stp_10.42.42.5(pid=12488): stdout: | (launched: 2022-12-10_13:15:13.401042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:15.243702 run osmo-stp_10.42.42.5(pid=12488): stderr: | [0;m[38;5;43m20221210131513593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131513594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131513594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131513594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131513595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131513595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131513595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:15.399449 run patchelf(pid=12491): Terminating (SIGINT) 13:15:15.579569 run patchelf(pid=12491): Terminated: ok {rc=0} 13:15:15.709165 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12488): Process ended prematurely: osmo-stp_10.42.42.5(pid=12488) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12488)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:15:15.719172 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:15:15.747283 run osmo-hlr_10.42.42.2(pid=12485): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12485)] 13:15:15.797314 run osmo-hlr_10.42.42.2(pid=12485): stdout: | (launched: 2022-12-10_13:15:12.402130) 13:15:15.849325 run osmo-hlr_10.42.42.2(pid=12485): stderr: | [0;m[1;31m20221210131512601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131512601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131512601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131512601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131512601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131512601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131512614 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131512622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131512622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131512622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:15.911724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12478): Terminating (SIGTERM) 13:15:15.954182 run iperf3-srv_10.42.42.10(pid=12479): Terminating (SIGTERM) 13:15:15.999053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12480): Terminating (SIGTERM) 13:15:16.049173 run iperf3-srv_10.42.42.10(pid=12481): Terminating (SIGTERM) 13:15:16.094061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12484): Terminating (SIGTERM) 13:15:16.136463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12487): Terminating (SIGTERM) 13:15:16.178771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12490): Terminating (SIGTERM) 13:15:16.222642 --- ParallelTerminationStrategy: PID 12478 died... 13:15:16.242429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12478): Terminated: ok {rc=0} 13:15:16.289114 --- ParallelTerminationStrategy: PID 12479 died... 13:15:16.308736 run iperf3-srv_10.42.42.10(pid=12479): Terminated {rc=256} 13:15:16.355163 --- ParallelTerminationStrategy: PID 12480 died... 13:15:16.375047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12480): Terminated: ok {rc=0} 13:15:16.421307 --- ParallelTerminationStrategy: PID 12481 died... 13:15:16.440818 run iperf3-srv_10.42.42.10(pid=12481): Terminated {rc=256} 13:15:16.487094 --- ParallelTerminationStrategy: PID 12484 died... 13:15:16.507001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12484): Terminated: ok {rc=0} 13:15:16.553610 --- ParallelTerminationStrategy: PID 12487 died... 13:15:16.573451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12487): Terminated: ok {rc=0} 13:15:16.619754 --- ParallelTerminationStrategy: PID 12490 died... 13:15:16.639558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12490): Terminated: ok {rc=0} 13:15:16.729961 bus /gobi_0: Setting Powered False 13:15:17.832906 bus /gobi_0: Setting Powered False 13:15:18.946496 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:15:20.094951 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:20.106762 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:15:20.183472 tst iperf3.py: using LAC 28645 13:15:20.309251 tst iperf3.py: using RAC 85 13:15:20.432557 tst iperf3.py: using CellId 28645 13:15:20.556716 tst iperf3.py: using BVCI 28646 13:15:20.672725 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:20.684057 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:20.695129 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:20.706295 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:20.717315 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:20.728357 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:20.739512 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:20.750680 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:20.761879 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:15:20.879080 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:15:21.094205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:21.414594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12492): Launched 13:15:21.692173 run iperf3-srv_10.42.42.10(pid=12493): Launched 13:15:21.811598 tst iperf3.py:8: start network... 13:15:22.026341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:22.520309 run create_hlr_db(pid=12494): Launched 13:15:22.649245 bus /gobi_6: Setting Powered False 13:15:23.712388 run create_hlr_db(pid=12494): Terminated: ok {rc=0} 13:15:24.139167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12496): Launched 13:15:24.438564 run osmo-hlr_10.42.42.2(pid=12497): Launched 13:15:24.553552 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:25.073727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12499): Launched 13:15:25.371405 run osmo-stp_10.42.42.5(pid=12500): Launched 13:15:25.485103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:15:26.002381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12502): Launched 13:15:26.116231 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:15:26.369204 run patchelf(pid=12503): Launched 13:15:26.535935 run osmo-stp_10.42.42.5(pid=12500): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12500)] 13:15:26.662891 run osmo-stp_10.42.42.5(pid=12500): stdout: | (launched: 2022-12-10_13:15:25.317294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:26.791343 run osmo-stp_10.42.42.5(pid=12500): stderr: | [0;m[38;5;43m20221210131525485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131525485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131525485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131525486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131525488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131525488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131525488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:26.920234 run osmo-stp_10.42.42.5(pid=12500): stdout: | (launched: 2022-12-10_13:15:25.317294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:27.043528 run osmo-stp_10.42.42.5(pid=12500): stderr: | [0;m[38;5;43m20221210131525485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131525485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131525485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131525486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131525488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131525488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131525488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:27.189715 run patchelf(pid=12503): Terminating (SIGINT) 13:15:27.358194 run patchelf(pid=12503): Terminated: ok {rc=0} 13:15:27.479535 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12500): Process ended prematurely: osmo-stp_10.42.42.5(pid=12500) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12500)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 13:15:27.490037 tst iperf3.py:8: Test FAILED (7.4 sec) 13:15:27.516878 run osmo-hlr_10.42.42.2(pid=12497): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12497)] 13:15:27.564749 run osmo-hlr_10.42.42.2(pid=12497): stdout: | (launched: 2022-12-10_13:15:24.384079) 13:15:27.613890 run osmo-hlr_10.42.42.2(pid=12497): stderr: | [0;m[1;31m20221210131524561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131524561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131524561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131524561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131524561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131524561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131524573 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131524582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131524582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131524583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:27.663372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12492): Terminating (SIGTERM) 13:15:27.703110 run iperf3-srv_10.42.42.10(pid=12493): Terminating (SIGTERM) 13:15:27.742410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12496): Terminating (SIGTERM) 13:15:27.782273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12499): Terminating (SIGTERM) 13:15:27.821870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12502): Terminating (SIGTERM) 13:15:27.861519 --- ParallelTerminationStrategy: PID 12492 died... 13:15:27.880417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12492): Terminated: ok {rc=0} 13:15:27.924274 --- ParallelTerminationStrategy: PID 12493 died... 13:15:27.942830 run iperf3-srv_10.42.42.10(pid=12493): Terminated {rc=256} 13:15:27.986198 --- ParallelTerminationStrategy: PID 12496 died... 13:15:28.004492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12496): Terminated: ok {rc=0} 13:15:28.047883 --- ParallelTerminationStrategy: PID 12499 died... 13:15:28.066366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12499): Terminated: ok {rc=0} 13:15:28.109962 --- ParallelTerminationStrategy: PID 12502 died... 13:15:28.128329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12502): Terminated: ok {rc=0} 13:15:28.213619 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:15:29.359209 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:29.370676 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:15:29.440714 tst iperf3m4.py: using LAC 28646 13:15:29.559615 tst iperf3m4.py: using RAC 86 13:15:29.679776 tst iperf3m4.py: using CellId 28646 13:15:29.801217 tst iperf3m4.py: using BVCI 28647 13:15:29.918391 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:29.929932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:29.941228 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:29.952546 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:29.964803 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:29.977314 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:29.988708 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:29.999886 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:30.011314 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:15:30.126409 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:15:30.245936 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:15:30.363976 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:15:30.482014 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:15:30.684041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:31.025807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12504): Launched 13:15:31.313673 run iperf3-srv_10.42.42.10(pid=12505): Launched 13:15:31.434548 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:15:31.638524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:31.951653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12506): Launched 13:15:32.227916 run iperf3-srv_10.42.42.10(pid=12507): Launched 13:15:32.340495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:15:32.540905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:32.840310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12508): Launched 13:15:33.099459 run iperf3-srv_10.42.42.10(pid=12509): Launched 13:15:33.211643 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:15:33.411998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:33.712312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12510): Launched 13:15:33.971712 run iperf3-srv_10.42.42.10(pid=12511): Launched 13:15:34.083654 tst iperf3m4.py:8: start network... 13:15:34.283907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:34.746856 run create_hlr_db(pid=12512): Launched 13:15:34.861131 bus /gobi_6: Setting Powered False 13:15:35.920942 run create_hlr_db(pid=12512): Terminated: ok {rc=0} 13:15:36.337083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12514): Launched 13:15:36.634661 run osmo-hlr_10.42.42.2(pid=12515): Launched 13:15:36.748572 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:37.283186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12517): Launched 13:15:37.581591 run osmo-stp_10.42.42.5(pid=12518): Launched 13:15:37.697915 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:15:38.216088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12520): Launched 13:15:38.330001 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:15:38.582416 run patchelf(pid=12521): Launched 13:15:38.748686 run osmo-stp_10.42.42.5(pid=12518): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12518)] 13:15:38.875253 run osmo-stp_10.42.42.5(pid=12518): stdout: | (launched: 2022-12-10_13:15:37.526534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:39.003373 run osmo-stp_10.42.42.5(pid=12518): stderr: | [0;m[38;5;43m20221210131537697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131537697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131537698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131537698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131537699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131537699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131537699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:39.131729 run osmo-stp_10.42.42.5(pid=12518): stdout: | (launched: 2022-12-10_13:15:37.526534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:39.254581 run osmo-stp_10.42.42.5(pid=12518): stderr: | [0;m[38;5;43m20221210131537697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131537697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131537698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131537698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131537699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131537699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131537699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:39.399868 run patchelf(pid=12521): Terminating (SIGINT) 13:15:39.567840 run patchelf(pid=12521): Terminated: ok {rc=0} 13:15:39.689294 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12518): Process ended prematurely: osmo-stp_10.42.42.5(pid=12518) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12518)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:15:39.698822 tst iperf3m4.py:8: Test FAILED (10.4 sec) 13:15:39.726465 run osmo-hlr_10.42.42.2(pid=12515): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12515)] 13:15:39.773552 run osmo-hlr_10.42.42.2(pid=12515): stdout: | (launched: 2022-12-10_13:15:36.580252) 13:15:39.822574 run osmo-hlr_10.42.42.2(pid=12515): stderr: | [0;m[1;31m20221210131536758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131536758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131536758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131536758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131536759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131536759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131536771 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131536781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131536782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131536782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:39.871720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12504): Terminating (SIGTERM) 13:15:39.910837 run iperf3-srv_10.42.42.10(pid=12505): Terminating (SIGTERM) 13:15:39.950752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12506): Terminating (SIGTERM) 13:15:39.990374 run iperf3-srv_10.42.42.10(pid=12507): Terminating (SIGTERM) 13:15:40.029601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12508): Terminating (SIGTERM) 13:15:40.069216 run iperf3-srv_10.42.42.10(pid=12509): Terminating (SIGTERM) 13:15:40.108397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12510): Terminating (SIGTERM) 13:15:40.147567 run iperf3-srv_10.42.42.10(pid=12511): Terminating (SIGTERM) 13:15:40.186650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12514): Terminating (SIGTERM) 13:15:40.226048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12517): Terminating (SIGTERM) 13:15:40.265283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12520): Terminating (SIGTERM) 13:15:40.305193 --- ParallelTerminationStrategy: PID 12504 died... 13:15:40.323796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12504): Terminated: ok {rc=0} 13:15:40.367362 --- ParallelTerminationStrategy: PID 12505 died... 13:15:40.385369 run iperf3-srv_10.42.42.10(pid=12505): Terminated {rc=256} 13:15:40.428831 --- ParallelTerminationStrategy: PID 12506 died... 13:15:40.447559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12506): Terminated: ok {rc=0} 13:15:40.491504 --- ParallelTerminationStrategy: PID 12507 died... 13:15:40.509649 run iperf3-srv_10.42.42.10(pid=12507): Terminated {rc=256} 13:15:40.552669 --- ParallelTerminationStrategy: PID 12508 died... 13:15:40.570944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12508): Terminated: ok {rc=0} 13:15:40.614325 --- ParallelTerminationStrategy: PID 12509 died... 13:15:40.632413 run iperf3-srv_10.42.42.10(pid=12509): Terminated {rc=256} 13:15:40.675929 --- ParallelTerminationStrategy: PID 12510 died... 13:15:40.694281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12510): Terminated: ok {rc=0} 13:15:40.737552 --- ParallelTerminationStrategy: PID 12511 died... 13:15:40.755631 run iperf3-srv_10.42.42.10(pid=12511): Terminated {rc=256} 13:15:40.798751 --- ParallelTerminationStrategy: PID 12514 died... 13:15:40.817042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12514): Terminated: ok {rc=0} 13:15:40.860470 --- ParallelTerminationStrategy: PID 12517 died... 13:15:40.878672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12517): Terminated: ok {rc=0} 13:15:40.922034 --- ParallelTerminationStrategy: PID 12520 died... 13:15:40.940259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12520): Terminated: ok {rc=0} 13:15:41.025440 bus /gobi_4: Setting Powered False 13:15:42.123728 bus /gobi_4: Setting Powered False 13:15:43.237724 bus /gobi_1: Setting Powered False 13:15:44.335070 bus /gobi_1: Setting Powered False 13:15:45.448794 bus /gobi_0: Setting Powered False 13:15:46.549059 bus /gobi_0: Setting Powered False 13:15:47.662868 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:15:48.765223 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:48.777196 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:15:48.848889 tst ping.py: using LAC 28647 13:15:48.973048 tst ping.py: using RAC 87 13:15:49.095612 tst ping.py: using CellId 28647 13:15:49.218625 tst ping.py: using BVCI 28648 13:15:49.332819 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:49.344323 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:49.355684 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:49.366909 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:49.378058 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:49.389305 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:49.400547 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:49.411803 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:15:49.527448 tst ping.py:19: start network... 13:15:49.737306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:50.219066 run create_hlr_db(pid=12522): Launched 13:15:50.345457 bus /gobi_6: Setting Powered False 13:15:51.407213 run create_hlr_db(pid=12522): Terminated: ok {rc=0} 13:15:51.826893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12524): Launched 13:15:52.120607 run osmo-hlr_10.42.42.2(pid=12525): Launched 13:15:52.232465 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:52.739476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12527): Launched 13:15:53.031656 run osmo-stp_10.42.42.5(pid=12528): Launched 13:15:53.143244 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:15:53.650999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12530): Launched 13:15:53.763344 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:15:54.012596 run patchelf(pid=12531): Launched 13:15:54.176487 run osmo-stp_10.42.42.5(pid=12528): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12528)] 13:15:54.301205 run osmo-stp_10.42.42.5(pid=12528): stdout: | (launched: 2022-12-10_13:15:52.977810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:54.427128 run osmo-stp_10.42.42.5(pid=12528): stderr: | [0;m[38;5;43m20221210131553147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131553147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131553148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131553148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131553149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131553149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131553149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:54.553935 run osmo-stp_10.42.42.5(pid=12528): stdout: | (launched: 2022-12-10_13:15:52.977810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:54.675214 run osmo-stp_10.42.42.5(pid=12528): stderr: | [0;m[38;5;43m20221210131553147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131553147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131553148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131553148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131553149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131553149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131553149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:54.818860 run patchelf(pid=12531): Terminating (SIGINT) 13:15:54.985262 run patchelf(pid=12531): Terminated: ok {rc=0} 13:15:55.104766 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12528): Process ended prematurely: osmo-stp_10.42.42.5(pid=12528) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12528)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 13:15:55.113677 tst ping.py:22: Test FAILED (6.3 sec) 13:15:55.140399 run osmo-hlr_10.42.42.2(pid=12525): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12525)] 13:15:55.187723 run osmo-hlr_10.42.42.2(pid=12525): stdout: | (launched: 2022-12-10_13:15:52.066705) 13:15:55.236544 run osmo-hlr_10.42.42.2(pid=12525): stderr: | [0;m[1;31m20221210131552240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131552240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131552240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131552240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131552240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131552240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131552252 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131552261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131552261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131552261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:55.285666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12524): Terminating (SIGTERM) 13:15:55.325127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12527): Terminating (SIGTERM) 13:15:55.364514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12530): Terminating (SIGTERM) 13:15:55.404124 --- ParallelTerminationStrategy: PID 12524 died... 13:15:55.422841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12524): Terminated: ok {rc=0} 13:15:55.466837 --- ParallelTerminationStrategy: PID 12527 died... 13:15:55.485263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12527): Terminated: ok {rc=0} 13:15:55.529071 --- ParallelTerminationStrategy: PID 12530 died... 13:15:55.547468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12530): Terminated: ok {rc=0} 13:15:55.632275 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:15:56.720552 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:56.732537 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:15:56.802719 tst ping_idle_ping.py: using LAC 28648 13:15:56.921243 tst ping_idle_ping.py: using RAC 88 13:15:57.038754 tst ping_idle_ping.py: using CellId 28648 13:15:57.156307 tst ping_idle_ping.py: using BVCI 28649 13:15:57.263521 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:57.274565 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:57.285306 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:57.296201 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:57.307147 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:57.318177 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:57.329183 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:15:57.339882 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:15:57.452708 tst ping_idle_ping.py:24: start network... 13:15:57.650112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:58.113698 run create_hlr_db(pid=12532): Launched 13:15:58.226968 bus /gobi_6: Setting Powered False 13:15:59.286056 run create_hlr_db(pid=12532): Terminated: ok {rc=0} 13:15:59.716701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12534): Launched 13:16:00.032081 run osmo-hlr_10.42.42.2(pid=12535): Launched 13:16:00.152006 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:00.696547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12537): Launched 13:16:01.035955 run osmo-stp_10.42.42.5(pid=12538): Launched 13:16:01.298611 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:01.973641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12540): Launched 13:16:02.099842 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:02.354050 run patchelf(pid=12541): Launched 13:16:02.518235 run osmo-stp_10.42.42.5(pid=12538): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12538)] 13:16:02.643313 run osmo-stp_10.42.42.5(pid=12538): stdout: | (launched: 2022-12-10_13:16:00.970738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:02.770025 run osmo-stp_10.42.42.5(pid=12538): stderr: | [0;m[38;5;43m20221210131601351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131601351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131601354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131601355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131601358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131601358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131601358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:02.896597 run osmo-stp_10.42.42.5(pid=12538): stdout: | (launched: 2022-12-10_13:16:00.970738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:03.018165 run osmo-stp_10.42.42.5(pid=12538): stderr: | [0;m[38;5;43m20221210131601351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131601351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131601354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131601355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131601358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131601358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131601358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:03.161761 run patchelf(pid=12541): Terminating (SIGINT) 13:16:03.328083 run patchelf(pid=12541): Terminated: ok {rc=0} 13:16:03.447792 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12538): Process ended prematurely: osmo-stp_10.42.42.5(pid=12538) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12538)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:16:03.456538 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:16:03.482842 run osmo-hlr_10.42.42.2(pid=12535): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12535)] 13:16:03.529843 run osmo-hlr_10.42.42.2(pid=12535): stdout: | (launched: 2022-12-10_13:15:59.974956) 13:16:03.578351 run osmo-hlr_10.42.42.2(pid=12535): stderr: | [0;m[1;31m20221210131600171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131600171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131600171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131600172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131600172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131600172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131600184 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131600192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131600193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131600193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:03.627144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12534): Terminating (SIGTERM) 13:16:03.666594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12537): Terminating (SIGTERM) 13:16:03.706682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12540): Terminating (SIGTERM) 13:16:03.746022 --- ParallelTerminationStrategy: PID 12534 died... 13:16:03.764543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12534): Terminated: ok {rc=0} 13:16:03.807997 --- ParallelTerminationStrategy: PID 12537 died... 13:16:03.826200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12537): Terminated: ok {rc=0} 13:16:03.869555 --- ParallelTerminationStrategy: PID 12540 died... 13:16:03.887755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12540): Terminated: ok {rc=0} 13:16:03.972270 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:16:05.274993 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:16:05.281247 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:16:05.315343 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:16:05.353297 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:16:05.438047 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:16:05.470776 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:16:05.508807 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:16:06.108618 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:16:06.161050 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:06.172386 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:16:06.244524 tst cs_paging_gprs_active.py: using LAC 28649 13:16:06.364867 tst cs_paging_gprs_active.py: using RAC 89 13:16:06.483588 tst cs_paging_gprs_active.py: using CellId 28649 13:16:06.603415 tst cs_paging_gprs_active.py: using BVCI 28650 13:16:06.715177 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:06.726266 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:06.737104 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:06.748047 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:06.758652 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:06.770290 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:06.781517 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:06.792437 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:06.803891 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:16:06.924453 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:16:07.040436 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:16:07.242922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:07.544043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12545): Launched 13:16:07.805168 run iperf3-srv_10.42.42.10(pid=12546): Launched 13:16:07.918419 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:16:08.118871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:08.420454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12547): Launched 13:16:08.682467 run iperf3-srv_10.42.42.10(pid=12548): Launched 13:16:08.795528 tst cs_paging_gprs_active.py:38: start network... 13:16:08.997343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:09.462094 run create_hlr_db(pid=12549): Launched 13:16:09.576284 bus /gobi_6: Setting Powered False 13:16:10.636499 run create_hlr_db(pid=12549): Terminated: ok {rc=0} 13:16:11.072702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12551): Launched 13:16:11.392857 run osmo-hlr_10.42.42.2(pid=12552): Launched 13:16:11.515282 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:12.065504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12554): Launched 13:16:12.385131 run osmo-stp_10.42.42.5(pid=12555): Launched 13:16:12.507290 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:13.058597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12557): Launched 13:16:13.180802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:13.450395 run patchelf(pid=12558): Launched 13:16:13.627606 run osmo-stp_10.42.42.5(pid=12555): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12555)] 13:16:13.762390 run osmo-stp_10.42.42.5(pid=12555): stdout: | (launched: 2022-12-10_13:16:12.327272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:13.898493 run osmo-stp_10.42.42.5(pid=12555): stderr: | [0;m[38;5;43m20221210131612517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131612517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131612517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131612518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131612518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131612518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131612518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:14.035445 run osmo-stp_10.42.42.5(pid=12555): stdout: | (launched: 2022-12-10_13:16:12.327272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:14.166517 run osmo-stp_10.42.42.5(pid=12555): stderr: | [0;m[38;5;43m20221210131612517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131612517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131612517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131612518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131612518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131612518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131612518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:14.322050 run patchelf(pid=12558): Terminating (SIGINT) 13:16:14.500476 run patchelf(pid=12558): Terminated: ok {rc=0} 13:16:14.629272 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12555): Process ended prematurely: osmo-stp_10.42.42.5(pid=12555) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12555)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:16:14.639460 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:16:14.667768 run osmo-hlr_10.42.42.2(pid=12552): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12552)] 13:16:14.717206 run osmo-hlr_10.42.42.2(pid=12552): stdout: | (launched: 2022-12-10_13:16:11.335140) 13:16:14.768082 run osmo-hlr_10.42.42.2(pid=12552): stderr: | [0;m[1;31m20221210131611532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131611532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131611532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131611532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131611532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131611532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131611547 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131611555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131611555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131611555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:14.819610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12545): Terminating (SIGTERM) 13:16:14.860826 run iperf3-srv_10.42.42.10(pid=12546): Terminating (SIGTERM) 13:16:14.902043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12547): Terminating (SIGTERM) 13:16:14.943292 run iperf3-srv_10.42.42.10(pid=12548): Terminating (SIGTERM) 13:16:14.984324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12551): Terminating (SIGTERM) 13:16:15.025568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12554): Terminating (SIGTERM) 13:16:15.066733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12557): Terminating (SIGTERM) 13:16:15.107975 --- ParallelTerminationStrategy: PID 12545 died... 13:16:15.127662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12545): Terminated: ok {rc=0} 13:16:15.173413 --- ParallelTerminationStrategy: PID 12546 died... 13:16:15.192553 run iperf3-srv_10.42.42.10(pid=12546): Terminated {rc=256} 13:16:15.238362 --- ParallelTerminationStrategy: PID 12547 died... 13:16:15.257553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12547): Terminated: ok {rc=0} 13:16:15.302790 --- ParallelTerminationStrategy: PID 12548 died... 13:16:15.321972 run iperf3-srv_10.42.42.10(pid=12548): Terminated {rc=256} 13:16:15.367397 --- ParallelTerminationStrategy: PID 12551 died... 13:16:15.386533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12551): Terminated: ok {rc=0} 13:16:15.431895 --- ParallelTerminationStrategy: PID 12554 died... 13:16:15.451154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12554): Terminated: ok {rc=0} 13:16:15.496555 --- ParallelTerminationStrategy: PID 12557 died... 13:16:15.515874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12557): Terminated: ok {rc=0} 13:16:15.601137 bus /gobi_0: Setting Powered False 13:16:16.703805 bus /gobi_0: Setting Powered False 13:16:17.821107 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:16:18.966542 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:18.978239 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:16:19.049997 tst iperf3.py: using LAC 28650 13:16:19.170238 tst iperf3.py: using RAC 90 13:16:19.290712 tst iperf3.py: using CellId 28650 13:16:19.412151 tst iperf3.py: using BVCI 28651 13:16:19.529419 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:19.540748 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:19.551924 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:19.563062 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:19.574237 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:19.585438 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:19.596596 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:19.607617 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:19.618897 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:16:19.734567 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:16:19.935362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:20.235996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12559): Launched 13:16:20.497942 run iperf3-srv_10.42.42.10(pid=12560): Launched 13:16:20.610693 tst iperf3.py:8: start network... 13:16:20.811478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:21.275407 run create_hlr_db(pid=12561): Launched 13:16:21.390945 bus /gobi_6: Setting Powered False 13:16:22.450173 run create_hlr_db(pid=12561): Terminated: ok {rc=0} 13:16:22.885872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12563): Launched 13:16:23.205129 run osmo-hlr_10.42.42.2(pid=12564): Launched 13:16:23.328369 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:23.878956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12566): Launched 13:16:24.196900 run osmo-stp_10.42.42.5(pid=12567): Launched 13:16:24.318873 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:24.870002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12569): Launched 13:16:24.991052 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:25.261208 run patchelf(pid=12570): Launched 13:16:25.438305 run osmo-stp_10.42.42.5(pid=12567): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12567)] 13:16:25.572941 run osmo-stp_10.42.42.5(pid=12567): stdout: | (launched: 2022-12-10_13:16:24.139669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:25.709346 run osmo-stp_10.42.42.5(pid=12567): stderr: | [0;m[38;5;43m20221210131624332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131624332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131624332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131624332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131624333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131624333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131624333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:25.845665 run osmo-stp_10.42.42.5(pid=12567): stdout: | (launched: 2022-12-10_13:16:24.139669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:25.976795 run osmo-stp_10.42.42.5(pid=12567): stderr: | [0;m[38;5;43m20221210131624332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131624332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131624332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131624332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131624333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131624333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131624333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:26.132795 run patchelf(pid=12570): Terminating (SIGINT) 13:16:26.313146 run patchelf(pid=12570): Terminated: ok {rc=0} 13:16:26.442121 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12567): Process ended prematurely: osmo-stp_10.42.42.5(pid=12567) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12567)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 13:16:26.452375 tst iperf3.py:8: Test FAILED (7.5 sec) 13:16:26.480605 run osmo-hlr_10.42.42.2(pid=12564): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12564)] 13:16:26.530417 run osmo-hlr_10.42.42.2(pid=12564): stdout: | (launched: 2022-12-10_13:16:23.147382) 13:16:26.581862 run osmo-hlr_10.42.42.2(pid=12564): stderr: | [0;m[1;31m20221210131623344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131623344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131623344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131623344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131623344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131623345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131623357 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131623365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131623365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131623365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:26.633832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12559): Terminating (SIGTERM) 13:16:26.675403 run iperf3-srv_10.42.42.10(pid=12560): Terminating (SIGTERM) 13:16:26.717064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12563): Terminating (SIGTERM) 13:16:26.758622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12566): Terminating (SIGTERM) 13:16:26.800190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12569): Terminating (SIGTERM) 13:16:26.842163 --- ParallelTerminationStrategy: PID 12559 died... 13:16:26.862080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12559): Terminated: ok {rc=0} 13:16:26.908041 --- ParallelTerminationStrategy: PID 12560 died... 13:16:26.927406 run iperf3-srv_10.42.42.10(pid=12560): Terminated {rc=256} 13:16:26.973587 --- ParallelTerminationStrategy: PID 12563 died... 13:16:26.992816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12563): Terminated: ok {rc=0} 13:16:27.038554 --- ParallelTerminationStrategy: PID 12566 died... 13:16:27.057934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12566): Terminated: ok {rc=0} 13:16:27.103934 --- ParallelTerminationStrategy: PID 12569 died... 13:16:27.123390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12569): Terminated: ok {rc=0} 13:16:27.210124 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:16:28.363602 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:28.375616 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:16:28.446957 tst iperf3m4.py: using LAC 28651 13:16:28.573538 tst iperf3m4.py: using RAC 91 13:16:28.698824 tst iperf3m4.py: using CellId 28651 13:16:28.824010 tst iperf3m4.py: using BVCI 28652 13:16:28.940272 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:28.951717 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:28.962925 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:28.974116 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:28.985270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:28.996354 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:29.007596 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:29.018738 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:29.030058 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:16:29.146386 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:16:29.266418 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:16:29.382054 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:16:29.501986 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:16:29.703891 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:30.004552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12572): Launched 13:16:30.266300 run iperf3-srv_10.42.42.10(pid=12573): Launched 13:16:30.378812 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:16:30.579394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:30.889741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12574): Launched 13:16:31.165153 run iperf3-srv_10.42.42.10(pid=12575): Launched 13:16:31.300350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:16:31.520645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:31.857703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12576): Launched 13:16:32.152478 run iperf3-srv_10.42.42.10(pid=12577): Launched 13:16:32.274493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:16:32.489827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:32.809218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12578): Launched 13:16:33.085280 run iperf3-srv_10.42.42.10(pid=12579): Launched 13:16:33.205017 tst iperf3m4.py:8: start network... 13:16:33.419802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:33.913847 run create_hlr_db(pid=12580): Launched 13:16:34.042061 bus /gobi_6: Setting Powered False 13:16:35.105623 run create_hlr_db(pid=12580): Terminated: ok {rc=0} 13:16:35.548716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12582): Launched 13:16:35.866800 run osmo-hlr_10.42.42.2(pid=12583): Launched 13:16:35.987368 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:36.540727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12585): Launched 13:16:36.858608 run osmo-stp_10.42.42.5(pid=12586): Launched 13:16:36.979228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:37.529189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12588): Launched 13:16:37.650233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:37.919476 run patchelf(pid=12589): Launched 13:16:38.096332 run osmo-stp_10.42.42.5(pid=12586): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12586)] 13:16:38.231683 run osmo-stp_10.42.42.5(pid=12586): stdout: | (launched: 2022-12-10_13:16:36.800754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:38.368662 run osmo-stp_10.42.42.5(pid=12586): stderr: | [0;m[38;5;43m20221210131636993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131636993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131636994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131636994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131636996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131636997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131636997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:38.505405 run osmo-stp_10.42.42.5(pid=12586): stdout: | (launched: 2022-12-10_13:16:36.800754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:38.636791 run osmo-stp_10.42.42.5(pid=12586): stderr: | [0;m[38;5;43m20221210131636993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131636993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131636994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131636994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131636996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131636997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131636997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:38.791934 run patchelf(pid=12589): Terminating (SIGINT) 13:16:38.970893 run patchelf(pid=12589): Terminated: ok {rc=0} 13:16:39.099780 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12586): Process ended prematurely: osmo-stp_10.42.42.5(pid=12586) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12586)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:16:39.109985 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:16:39.138481 run osmo-hlr_10.42.42.2(pid=12583): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12583)] 13:16:39.187853 run osmo-hlr_10.42.42.2(pid=12583): stdout: | (launched: 2022-12-10_13:16:35.808566) 13:16:39.239014 run osmo-hlr_10.42.42.2(pid=12583): stderr: | [0;m[1;31m20221210131636008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131636008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131636008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131636008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131636008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131636008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131636022 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131636030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131636030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131636030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:39.290998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12572): Terminating (SIGTERM) 13:16:39.332452 run iperf3-srv_10.42.42.10(pid=12573): Terminating (SIGTERM) 13:16:39.373879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12574): Terminating (SIGTERM) 13:16:39.415274 run iperf3-srv_10.42.42.10(pid=12575): Terminating (SIGTERM) 13:16:39.456620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12576): Terminating (SIGTERM) 13:16:39.498066 run iperf3-srv_10.42.42.10(pid=12577): Terminating (SIGTERM) 13:16:39.539382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12578): Terminating (SIGTERM) 13:16:39.580723 run iperf3-srv_10.42.42.10(pid=12579): Terminating (SIGTERM) 13:16:39.622090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12582): Terminating (SIGTERM) 13:16:39.663448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12585): Terminating (SIGTERM) 13:16:39.704838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12588): Terminating (SIGTERM) 13:16:39.746593 --- ParallelTerminationStrategy: PID 12572 died... 13:16:39.766383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12572): Terminated: ok {rc=0} 13:16:39.812130 --- ParallelTerminationStrategy: PID 12573 died... 13:16:39.831362 run iperf3-srv_10.42.42.10(pid=12573): Terminated {rc=256} 13:16:39.876522 --- ParallelTerminationStrategy: PID 12574 died... 13:16:39.895815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12574): Terminated: ok {rc=0} 13:16:39.941436 --- ParallelTerminationStrategy: PID 12575 died... 13:16:39.960807 run iperf3-srv_10.42.42.10(pid=12575): Terminated {rc=256} 13:16:40.006476 --- ParallelTerminationStrategy: PID 12576 died... 13:16:40.025749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12576): Terminated: ok {rc=0} 13:16:40.071287 --- ParallelTerminationStrategy: PID 12577 died... 13:16:40.090626 run iperf3-srv_10.42.42.10(pid=12577): Terminated {rc=256} 13:16:40.136180 --- ParallelTerminationStrategy: PID 12578 died... 13:16:40.155739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12578): Terminated: ok {rc=0} 13:16:40.201297 --- ParallelTerminationStrategy: PID 12579 died... 13:16:40.220525 run iperf3-srv_10.42.42.10(pid=12579): Terminated {rc=256} 13:16:40.266414 --- ParallelTerminationStrategy: PID 12582 died... 13:16:40.285854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12582): Terminated: ok {rc=0} 13:16:40.331566 --- ParallelTerminationStrategy: PID 12585 died... 13:16:40.350924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12585): Terminated: ok {rc=0} 13:16:40.396606 --- ParallelTerminationStrategy: PID 12588 died... 13:16:40.415920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12588): Terminated: ok {rc=0} 13:16:40.501847 bus /gobi_4: Setting Powered False 13:16:41.600286 bus /gobi_4: Setting Powered False 13:16:42.716804 bus /gobi_1: Setting Powered False 13:16:43.812920 bus /gobi_1: Setting Powered False 13:16:44.927370 bus /gobi_0: Setting Powered False 13:16:46.022133 bus /gobi_0: Setting Powered False 13:16:47.141248 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:16:48.244529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:48.255974 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:16:48.330561 tst ping.py: using LAC 28652 13:16:48.447166 tst ping.py: using RAC 92 13:16:48.561960 tst ping.py: using CellId 28652 13:16:48.676060 tst ping.py: using BVCI 28653 13:16:48.783721 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:48.794647 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:48.805477 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:48.817075 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:48.828366 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:48.839778 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:48.851317 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:48.862611 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:16:48.981309 tst ping.py:19: start network... 13:16:49.191606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:49.675563 run create_hlr_db(pid=12590): Launched 13:16:49.802736 bus /gobi_6: Setting Powered False 13:16:50.865201 run create_hlr_db(pid=12590): Terminated: ok {rc=0} 13:16:51.284342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12592): Launched 13:16:51.577698 run osmo-hlr_10.42.42.2(pid=12593): Launched 13:16:51.690493 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:52.215445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12595): Launched 13:16:52.508552 run osmo-stp_10.42.42.5(pid=12596): Launched 13:16:52.619827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:53.125257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12598): Launched 13:16:53.237271 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:53.484322 run patchelf(pid=12599): Launched 13:16:53.647805 run osmo-stp_10.42.42.5(pid=12596): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12596)] 13:16:53.772365 run osmo-stp_10.42.42.5(pid=12596): stdout: | (launched: 2022-12-10_13:16:52.454977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:53.898815 run osmo-stp_10.42.42.5(pid=12596): stderr: | [0;m[38;5;43m20221210131652623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131652623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131652624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131652624 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131652624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131652625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131652625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:54.024719 run osmo-stp_10.42.42.5(pid=12596): stdout: | (launched: 2022-12-10_13:16:52.454977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:54.145552 run osmo-stp_10.42.42.5(pid=12596): stderr: | [0;m[38;5;43m20221210131652623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131652623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131652624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131652624 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131652624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131652625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131652625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:54.289405 run patchelf(pid=12599): Terminating (SIGINT) 13:16:54.455466 run patchelf(pid=12599): Terminated: ok {rc=0} 13:16:54.574923 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12596): Process ended prematurely: osmo-stp_10.42.42.5(pid=12596) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12596)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 13:16:54.583610 tst ping.py:22: Test FAILED (6.3 sec) 13:16:54.610175 run osmo-hlr_10.42.42.2(pid=12593): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12593)] 13:16:54.657530 run osmo-hlr_10.42.42.2(pid=12593): stdout: | (launched: 2022-12-10_13:16:51.523971) 13:16:54.706432 run osmo-hlr_10.42.42.2(pid=12593): stderr: | [0;m[1;31m20221210131651699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131651699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131651699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131651699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131651699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131651699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131651711 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131651722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131651722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131651722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:54.755700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12592): Terminating (SIGTERM) 13:16:54.795217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12595): Terminating (SIGTERM) 13:16:54.834621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12598): Terminating (SIGTERM) 13:16:54.874518 --- ParallelTerminationStrategy: PID 12592 died... 13:16:54.893235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12592): Terminated: ok {rc=0} 13:16:54.936835 --- ParallelTerminationStrategy: PID 12595 died... 13:16:54.955060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12595): Terminated: ok {rc=0} 13:16:54.998825 --- ParallelTerminationStrategy: PID 12598 died... 13:16:55.016935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12598): Terminated: ok {rc=0} 13:16:55.100693 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:16:56.186486 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:56.198992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:16:56.271599 tst ping_idle_ping.py: using LAC 28653 13:16:56.390402 tst ping_idle_ping.py: using RAC 93 13:16:56.511430 tst ping_idle_ping.py: using CellId 28653 13:16:56.626704 tst ping_idle_ping.py: using BVCI 28654 13:16:56.735823 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:56.746751 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:56.757497 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:56.768415 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:56.779248 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:56.790305 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:56.801496 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:16:56.812366 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:16:56.927702 tst ping_idle_ping.py:24: start network... 13:16:57.124829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:57.582113 run create_hlr_db(pid=12601): Launched 13:16:57.695136 bus /gobi_6: Setting Powered False 13:16:58.758577 run create_hlr_db(pid=12601): Terminated: ok {rc=0} 13:16:59.195041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12603): Launched 13:16:59.508133 run osmo-hlr_10.42.42.2(pid=12604): Launched 13:16:59.628290 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:00.171285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12606): Launched 13:17:00.485982 run osmo-stp_10.42.42.5(pid=12607): Launched 13:17:00.606304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:01.181369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12609): Launched 13:17:01.343733 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:01.654206 run patchelf(pid=12613): Launched 13:17:01.872919 run osmo-stp_10.42.42.5(pid=12607): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12607)] 13:17:02.009103 run osmo-stp_10.42.42.5(pid=12607): stdout: | (launched: 2022-12-10_13:17:00.428553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:02.147902 run osmo-stp_10.42.42.5(pid=12607): stderr: | [0;m[38;5;43m20221210131700619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131700619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131700619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131700620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131700620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131700620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131700620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:02.285164 run osmo-stp_10.42.42.5(pid=12607): stdout: | (launched: 2022-12-10_13:17:00.428553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:02.415542 run osmo-stp_10.42.42.5(pid=12607): stderr: | [0;m[38;5;43m20221210131700619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131700619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131700619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131700620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131700620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131700620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131700620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:02.568816 run patchelf(pid=12613): Terminating (SIGINT) 13:17:02.746747 run patchelf(pid=12613): Terminated: ok {rc=0} 13:17:02.874870 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12607): Process ended prematurely: osmo-stp_10.42.42.5(pid=12607) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12607)] [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:17:02.884534 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:17:02.912543 run osmo-hlr_10.42.42.2(pid=12604): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12604)] 13:17:02.962287 run osmo-hlr_10.42.42.2(pid=12604): stdout: | (launched: 2022-12-10_13:16:59.451273) 13:17:03.013807 run osmo-hlr_10.42.42.2(pid=12604): stderr: | [0;m[1;31m20221210131659648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131659649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131659649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131659649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131659649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131659649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131659661 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131659672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131659672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131659672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:03.065647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12603): Terminating (SIGTERM) 13:17:03.107390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12606): Terminating (SIGTERM) 13:17:03.149027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12609): Terminating (SIGTERM) 13:17:03.190940 --- ParallelTerminationStrategy: PID 12603 died... 13:17:03.210857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12603): Terminated: ok {rc=0} 13:17:03.257042 --- ParallelTerminationStrategy: PID 12606 died... 13:17:03.276404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12606): Terminated: ok {rc=0} 13:17:03.322068 --- ParallelTerminationStrategy: PID 12609 died... 13:17:03.341557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12609): Terminated: ok {rc=0} 13:17:03.429785 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:17:04.738921 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:17:04.746503 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:17:04.781321 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:17:04.816362 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:17:04.869547 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:17:04.903515 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:17:04.938085 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:17:05.498208 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:17:05.503807 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:17:05.515514 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:17:05.586909 tst switch_tch_pdch.py: using LAC 28654 13:17:05.709653 tst switch_tch_pdch.py: using RAC 94 13:17:05.834177 tst switch_tch_pdch.py: using CellId 28654 13:17:05.963134 tst switch_tch_pdch.py: using BVCI 28655 13:17:06.077852 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:17:06.089557 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:17:06.100917 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:17:06.112462 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:17:06.123935 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:17:06.135263 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:17:06.146833 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:17:06.158335 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:17:06.272565 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:17:06.392336 tst switch_tch_pdch.py:51: start network... 13:17:06.602632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:07.088095 run create_hlr_db(pid=12617): Launched 13:17:07.215664 bus /gobi_6: Setting Powered False 13:17:08.277925 run create_hlr_db(pid=12617): Terminated: ok {rc=0} 13:17:08.699236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12619): Launched 13:17:08.993170 run osmo-hlr_10.42.42.2(pid=12620): Launched 13:17:09.105306 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:09.626208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12622): Launched 13:17:09.918807 run osmo-stp_10.42.42.5(pid=12623): Launched 13:17:10.030205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:10.537886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12625): Launched 13:17:10.649852 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:10.899269 run patchelf(pid=12626): Launched 13:17:11.062956 run osmo-stp_10.42.42.5(pid=12623): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12623)] 13:17:11.187823 run osmo-stp_10.42.42.5(pid=12623): stdout: | (launched: 2022-12-10_13:17:09.865415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:11.314490 run osmo-stp_10.42.42.5(pid=12623): stderr: | [0;m[38;5;43m20221210131710033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131710033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131710033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131710034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131710034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131710034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131710034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:11.441272 run osmo-stp_10.42.42.5(pid=12623): stdout: | (launched: 2022-12-10_13:17:09.865415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:11.562423 run osmo-stp_10.42.42.5(pid=12623): stderr: | [0;m[38;5;43m20221210131710033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131710033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131710033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131710034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131710034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131710034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131710034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:11.705859 run patchelf(pid=12626): Terminating (SIGINT) 13:17:11.871767 run patchelf(pid=12626): Terminated: ok {rc=0} 13:17:11.990811 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12623): Process ended prematurely: osmo-stp_10.42.42.5(pid=12623) [trial-2375↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12623)] [trial-2375↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:17:11.999531 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 13:17:12.026143 run osmo-hlr_10.42.42.2(pid=12620): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12620)] 13:17:12.073674 run osmo-hlr_10.42.42.2(pid=12620): stdout: | (launched: 2022-12-10_13:17:08.939619) 13:17:12.122361 run osmo-hlr_10.42.42.2(pid=12620): stderr: | [0;m[1;31m20221210131709113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131709113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131709113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131709113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131709113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131709113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131709126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131709134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131709134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131709135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:12.171634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12619): Terminating (SIGTERM) 13:17:12.211172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12622): Terminating (SIGTERM) 13:17:12.250668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12625): Terminating (SIGTERM) 13:17:12.290544 --- ParallelTerminationStrategy: PID 12619 died... 13:17:12.309324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12619): Terminated: ok {rc=0} 13:17:12.353061 --- ParallelTerminationStrategy: PID 12622 died... 13:17:12.371296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12622): Terminated: ok {rc=0} 13:17:12.415081 --- ParallelTerminationStrategy: PID 12625 died... 13:17:12.433280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12625): Terminated: ok {rc=0} 13:17:12.517633 bus /gobi_0: Setting Powered False 13:17:13.615048 bus /gobi_0: Setting Powered False 13:17:14.726631 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:17:16.012488 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:17:16.019909 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:17:16.056331 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:17:16.093506 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:17:16.145990 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:17:16.181443 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:17:16.218305 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:17:16.801878 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:17:16.809262 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:17:16.821853 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:17:16.899170 tst switch_tch_pdch.py: using LAC 28655 13:17:17.046684 tst switch_tch_pdch.py: using RAC 95 13:17:17.166160 tst switch_tch_pdch.py: using CellId 28655 13:17:17.283410 tst switch_tch_pdch.py: using BVCI 28656 13:17:17.392411 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:17:17.403483 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:17:17.414350 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:17:17.426178 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:17:17.437510 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:17:17.449198 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:17:17.460593 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:17:17.472082 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:17:17.590500 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:17:17.705692 tst switch_tch_pdch.py:51: start network... 13:17:17.903728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:18.335096 run create_hlr_db(pid=12631): Launched 13:17:18.447480 bus /gobi_6: Setting Powered False 13:17:19.506344 run create_hlr_db(pid=12631): Terminated: ok {rc=0} 13:17:19.909923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12633): Launched 13:17:20.223210 run osmo-hlr_10.42.42.2(pid=12634): Launched 13:17:20.343271 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:20.856031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12636): Launched 13:17:21.168874 run osmo-stp_10.42.42.5(pid=12637): Launched 13:17:21.289253 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:21.803279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12639): Launched 13:17:21.922704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:22.186562 run patchelf(pid=12640): Launched 13:17:22.361567 run osmo-stp_10.42.42.5(pid=12637): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12637)] 13:17:22.494776 run osmo-stp_10.42.42.5(pid=12637): stdout: | (launched: 2022-12-10_13:17:21.111745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:22.629653 run osmo-stp_10.42.42.5(pid=12637): stderr: | [0;m[38;5;43m20221210131721302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131721303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131721303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131721303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131721304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131721304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131721304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:22.763950 run osmo-stp_10.42.42.5(pid=12637): stdout: | (launched: 2022-12-10_13:17:21.111745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:22.893588 run osmo-stp_10.42.42.5(pid=12637): stderr: | [0;m[38;5;43m20221210131721302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131721303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131721303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131721303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131721304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131721304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131721304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:23.045959 run patchelf(pid=12640): Terminating (SIGINT) 13:17:23.222341 run patchelf(pid=12640): Terminated: ok {rc=0} 13:17:23.349381 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12637): Process ended prematurely: osmo-stp_10.42.42.5(pid=12637) [trial-2375↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12637)] [trial-2375↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:17:23.358953 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 13:17:23.386571 run osmo-hlr_10.42.42.2(pid=12634): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12634)] 13:17:23.436130 run osmo-hlr_10.42.42.2(pid=12634): stdout: | (launched: 2022-12-10_13:17:20.166148) 13:17:23.487424 run osmo-hlr_10.42.42.2(pid=12634): stderr: | [0;m[1;31m20221210131720363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131720363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131720363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131720363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131720363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131720363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131720376 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131720384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131720384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131720384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:23.538997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12633): Terminating (SIGTERM) 13:17:23.580619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12636): Terminating (SIGTERM) 13:17:23.622142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12639): Terminating (SIGTERM) 13:17:23.663848 --- ParallelTerminationStrategy: PID 12633 died... 13:17:23.683623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12633): Terminated: ok {rc=0} 13:17:23.729740 --- ParallelTerminationStrategy: PID 12636 died... 13:17:23.749209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12636): Terminated: ok {rc=0} 13:17:23.795005 --- ParallelTerminationStrategy: PID 12639 died... 13:17:23.814468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12639): Terminated: ok {rc=0} 13:17:23.900778 bus /gobi_0: Setting Powered False 13:17:24.999953 bus /gobi_0: Setting Powered False 13:17:26.115459 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_sms:trx-umtrx --------------------------------------------------------------------- 13:17:27.369199 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:17:27.373159 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:17:27.405827 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 13:17:27.412665 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 13:17:27.463713 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:17:27.496149 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 13:17:27.502988 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 13:17:28.042703 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 13:17:28.047603 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 13:17:28.058654 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 13:17:28.105473 tst mo_mt_sms.py: using LAC 28656 13:17:28.229866 tst mo_mt_sms.py: using RAC 96 13:17:28.352861 tst mo_mt_sms.py: using CellId 28656 13:17:28.475487 tst mo_mt_sms.py: using BVCI 28657 13:17:28.591059 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:17:28.705383 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:17:28.815474 tst mo_mt_sms.py:9: start nitb and bts... 13:17:29.013872 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:17:29.613181 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12644): Launched 13:17:29.906815 run osmo-nitb_10.42.42.2(pid=12645): Launched 13:17:30.069236 run osmo-nitb_10.42.42.2(pid=12645): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12645)] 13:17:30.201444 run osmo-nitb_10.42.42.2(pid=12645): stdout: | (launched: 2022-12-10_13:17:29.853217) 13:17:30.334493 run osmo-nitb_10.42.42.2(pid=12645): stderr: | (launched: 2022-12-10_13:17:29.896908) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:17:30.467427 run osmo-nitb_10.42.42.2(pid=12645): stdout: | (launched: 2022-12-10_13:17:29.853217) 13:17:30.595957 run osmo-nitb_10.42.42.2(pid=12645): stderr: | (launched: 2022-12-10_13:17:29.896908) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12645): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12645) [trial-2375↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12645)] 13:17:31.017444 tst osmo-nitb_10.42.42.2(pid=12645): stdout: | (launched: 2022-12-10_13:17:29.853217) 13:17:31.186769 tst osmo-nitb_10.42.42.2(pid=12645): stderr: | (launched: 2022-12-10_13:17:29.896908) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:17:31.338173 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12645): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12645) [trial-2375↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12645)] [trial-2375↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 13:17:31.347492 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 13:17:31.354996 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12644): Terminating (SIGTERM) 13:17:31.566333 --- ParallelTerminationStrategy: PID 12644 died... 13:17:31.588495 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12644): Terminated: ok {rc=0} 13:17:31.678915 bus /sierra_3: Setting Powered False 13:17:32.777509 bus /sierra_3: Setting Powered False 13:17:33.892254 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 sms:trx-umtrx --------------------------------------------------------------------- 13:17:35.089539 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:17:35.093882 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:17:35.126459 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 13:17:35.153312 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 13:17:35.204656 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:17:35.237402 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 13:17:35.264368 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 13:17:35.811671 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 13:17:35.816711 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:17:35.827549 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 13:17:35.874395 tst mo_mt_sms.py: using LAC 28657 13:17:36.001665 tst mo_mt_sms.py: using RAC 97 13:17:36.126513 tst mo_mt_sms.py: using CellId 28657 13:17:36.249758 tst mo_mt_sms.py: using BVCI 28658 13:17:36.365105 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:17:36.375884 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:17:36.386646 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:17:36.397387 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:17:36.408046 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:17:36.418793 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:17:36.532144 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:17:36.645339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:37.100916 run create_hlr_db(pid=12651): Launched 13:17:37.214066 bus /sierra_2: Setting Powered False 13:17:38.272760 run create_hlr_db(pid=12651): Terminated: ok {rc=0} 13:17:38.681752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12653): Launched 13:17:38.974109 run osmo-hlr_10.42.42.2(pid=12654): Launched 13:17:39.085987 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:39.591319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12656): Launched 13:17:39.886184 run osmo-stp_10.42.42.5(pid=12657): Launched 13:17:39.999946 run osmo-msc_10.42.42.6: Starting osmo-msc 13:17:40.531876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12659): Launched 13:17:40.825667 run osmo-msc_10.42.42.6(pid=12660): Launched 13:17:40.989386 run osmo-stp_10.42.42.5(pid=12657): ERR: Terminated: ERROR {rc=1} [trial-2375↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12657)] 13:17:41.115294 run osmo-stp_10.42.42.5(pid=12657): stdout: | (launched: 2022-12-10_13:17:39.832486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:41.241252 run osmo-stp_10.42.42.5(pid=12657): stderr: | [0;m[38;5;43m20221210131740004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131740004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131740005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131740005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131740006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131740006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131740006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:41.364300 run osmo-stp_10.42.42.5(pid=12657): stdout: | (launched: 2022-12-10_13:17:39.832486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:41.481553 run osmo-stp_10.42.42.5(pid=12657): stderr: | [0;m[38;5;43m20221210131740004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131740004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131740005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131740005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131740006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131740006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131740006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:41.621531 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12657): Process ended prematurely: osmo-stp_10.42.42.5(pid=12657) [trial-2375↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12657)] [trial-2375↪sms:trx-umtrx↪mo_mt_sms.py:16] 13:17:41.629824 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 13:17:41.656178 run osmo-hlr_10.42.42.2(pid=12654): ERR: Terminated: ERROR {rc=237} [trial-2375↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12654)] 13:17:41.703789 run osmo-hlr_10.42.42.2(pid=12654): stdout: | (launched: 2022-12-10_13:17:38.920350) 13:17:41.752912 run osmo-hlr_10.42.42.2(pid=12654): stderr: | [0;m[1;31m20221210131739094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131739094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131739094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131739094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131739094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131739095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131739107 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131739117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131739118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131739118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:41.821297 run osmo-msc_10.42.42.6(pid=12660): ERR: Terminated: ERROR {rc=2} [trial-2375↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12660)] 13:17:41.868715 run osmo-msc_10.42.42.6(pid=12660): stdout: | (launched: 2022-12-10_13:17:40.771951) 13:17:41.917582 run osmo-msc_10.42.42.6(pid=12660): stderr: | [0;m[38;5;43m20221210131741046 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131741046 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f13e9016c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131741046 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131741046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131741047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131741047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131741048 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131741049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131741049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131741049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:17:41.967160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12653): Terminating (SIGTERM) 13:17:42.006547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12656): Terminating (SIGTERM) 13:17:42.045979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12659): Terminating (SIGTERM) 13:17:42.085807 --- ParallelTerminationStrategy: PID 12653 died... 13:17:42.104549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12653): Terminated: ok {rc=0} 13:17:42.148677 --- ParallelTerminationStrategy: PID 12656 died... 13:17:42.167015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12656): Terminated: ok {rc=0} 13:17:42.210352 --- ParallelTerminationStrategy: PID 12659 died... 13:17:42.228527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12659): Terminated: ok {rc=0} 13:17:42.313935 bus /sierra_3: Setting Powered False 13:17:43.411794 bus /sierra_3: Setting Powered False 13:17:44.525753 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 13:17:45.749085 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:17:45.752589 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:17:45.785082 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 13:17:45.791689 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 13:17:45.826333 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:17:45.877680 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 13:17:45.885700 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 13:17:46.383109 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2375 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 13:17:46.391310 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 13:17:46.404744 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 13:17:46.466289 tst assert_extension.py: using LAC 28658 13:17:46.585088 tst assert_extension.py: using RAC 98 13:17:46.730148 tst assert_extension.py: using CellId 28658 13:17:46.870423 tst assert_extension.py: using BVCI 28659 13:17:46.985505 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 13:17:47.123181 tst assert_extension.py:10: start nitb and bts... 13:17:47.366227 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:17:48.007305 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12665): Launched 13:17:48.321946 run osmo-nitb_10.42.42.2(pid=12666): Launched 13:17:48.496101 run osmo-nitb_10.42.42.2(pid=12666): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12666)] 13:17:48.637062 run osmo-nitb_10.42.42.2(pid=12666): stdout: | (launched: 2022-12-10_13:17:48.264840) 13:17:48.779528 run osmo-nitb_10.42.42.2(pid=12666): stderr: | (launched: 2022-12-10_13:17:48.312050) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:17:48.921310 run osmo-nitb_10.42.42.2(pid=12666): stdout: | (launched: 2022-12-10_13:17:48.264840) 13:17:49.057528 run osmo-nitb_10.42.42.2(pid=12666): stderr: | (launched: 2022-12-10_13:17:48.312050) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12666): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12666) [trial-2375↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12666)] 13:17:49.440865 tst osmo-nitb_10.42.42.2(pid=12666): stdout: | (launched: 2022-12-10_13:17:48.264840) 13:17:49.567073 tst osmo-nitb_10.42.42.2(pid=12666): stderr: | (launched: 2022-12-10_13:17:48.312050) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:17:49.716176 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12666): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12666) [trial-2375↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12666)] [trial-2375↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 13:17:49.725222 tst assert_extension.py:12: Test FAILED (3.3 sec) 13:17:49.732232 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12665): Terminating (SIGTERM) 13:17:49.942492 --- ParallelTerminationStrategy: PID 12665 died... 13:17:49.963945 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12665): Terminated: ok {rc=0} 13:17:50.049781 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 ussd:trx-umtrx --------------------------------------------------------------------- 13:17:51.225761 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:17:51.229857 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:17:51.262509 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 13:17:51.289634 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 13:17:51.324175 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:17:51.357254 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 13:17:51.384212 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 13:17:51.913884 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2375 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 13:17:51.919927 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:17:51.931465 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 13:17:51.978182 tst assert_extension.py: using LAC 28659 13:17:52.096775 tst assert_extension.py: using RAC 99 13:17:52.213225 tst assert_extension.py: using CellId 28659 13:17:52.337761 tst assert_extension.py: using BVCI 28660 13:17:52.451463 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:17:52.462386 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:17:52.473172 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:17:52.483827 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:17:52.494643 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:17:52.505346 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 13:17:52.617904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:53.072267 run create_hlr_db(pid=12670): Launched 13:17:53.185740 bus /sierra_2: Setting Powered False 13:17:54.245086 run create_hlr_db(pid=12670): Terminated: ok {rc=0} 13:17:54.675975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12672): Launched 13:17:54.975512 run osmo-hlr_10.42.42.2(pid=12673): Launched 13:17:55.088417 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:55.612420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12675): Launched 13:17:55.905953 run osmo-stp_10.42.42.5(pid=12676): Launched 13:17:56.017990 run osmo-msc_10.42.42.6: Starting osmo-msc 13:17:56.548512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12678): Launched 13:17:56.841366 run osmo-msc_10.42.42.6(pid=12679): Launched 13:17:57.005358 run osmo-stp_10.42.42.5(pid=12676): ERR: Terminated: ERROR {rc=1} [trial-2375↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12676)] 13:17:57.131146 run osmo-stp_10.42.42.5(pid=12676): stdout: | (launched: 2022-12-10_13:17:55.852391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:57.256648 run osmo-stp_10.42.42.5(pid=12676): stderr: | [0;m[38;5;43m20221210131756021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131756021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131756021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131756022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131756022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131756022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131756022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:57.380041 run osmo-stp_10.42.42.5(pid=12676): stdout: | (launched: 2022-12-10_13:17:55.852391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:57.497477 run osmo-stp_10.42.42.5(pid=12676): stderr: | [0;m[38;5;43m20221210131756021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131756021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131756021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131756022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131756022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131756022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131756022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:57.637577 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12676): Process ended prematurely: osmo-stp_10.42.42.5(pid=12676) [trial-2375↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12676)] [trial-2375↪ussd:trx-umtrx↪assert_extension.py:17] 13:17:57.646010 tst assert_extension.py:17: Test FAILED (5.7 sec) 13:17:57.672346 run osmo-hlr_10.42.42.2(pid=12673): ERR: Terminated: ERROR {rc=237} [trial-2375↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12673)] 13:17:57.720048 run osmo-hlr_10.42.42.2(pid=12673): stdout: | (launched: 2022-12-10_13:17:54.921834) 13:17:57.769286 run osmo-hlr_10.42.42.2(pid=12673): stderr: | [0;m[1;31m20221210131755096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131755097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131755097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131755097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131755097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131755097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131755108 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131755117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131755117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131755117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:57.838046 run osmo-msc_10.42.42.6(pid=12679): ERR: Terminated: ERROR {rc=2} [trial-2375↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12679)] 13:17:57.885608 run osmo-msc_10.42.42.6(pid=12679): stdout: | (launched: 2022-12-10_13:17:56.788109) 13:17:57.934611 run osmo-msc_10.42.42.6(pid=12679): stderr: | [0;m[38;5;43m20221210131757058 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131757058 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f403f7f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131757058 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131757058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131757058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131757058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131757060 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131757060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131757061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131757061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:17:57.984044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12672): Terminating (SIGTERM) 13:17:58.023562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12675): Terminating (SIGTERM) 13:17:58.063296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12678): Terminating (SIGTERM) 13:17:58.103325 --- ParallelTerminationStrategy: PID 12672 died... 13:17:58.122153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12672): Terminated: ok {rc=0} 13:17:58.166117 --- ParallelTerminationStrategy: PID 12675 died... 13:17:58.184368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12675): Terminated: ok {rc=0} 13:17:58.228239 --- ParallelTerminationStrategy: PID 12678 died... 13:17:58.246672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12678): Terminated: ok {rc=0} 13:17:58.331809 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:17:59.536431 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:17:59.543269 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:17:59.576493 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:17:59.603043 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:17:59.654802 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:17:59.688091 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:17:59.714108 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:18:00.264555 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:18:00.313942 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:18:00.325148 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:18:00.390771 tst mo_mt_call.py: using LAC 28660 13:18:00.507107 tst mo_mt_call.py: using RAC 100 13:18:00.623491 tst mo_mt_call.py: using CellId 28660 13:18:00.739774 tst mo_mt_call.py: using BVCI 28661 13:18:00.858704 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:18:00.871202 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:18:00.883572 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:18:00.896541 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:18:00.914086 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:18:00.926372 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:18:01.049381 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:18:01.166548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:01.688061 run create_hlr_db(pid=12684): Launched 13:18:01.851403 bus /sierra_2: Setting Powered False 13:18:02.914083 run create_hlr_db(pid=12684): Terminated: ok {rc=0} 13:18:03.340010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12686): Launched 13:18:03.638330 run osmo-hlr_10.42.42.2(pid=12687): Launched 13:18:03.752337 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:04.285580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12689): Launched 13:18:04.587071 run osmo-stp_10.42.42.5(pid=12690): Launched 13:18:04.703012 run osmo-msc_10.42.42.6: Starting osmo-msc 13:18:05.247275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12692): Launched 13:18:05.545789 run osmo-msc_10.42.42.6(pid=12693): Launched 13:18:05.714732 run osmo-stp_10.42.42.5(pid=12690): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12690)] 13:18:05.843152 run osmo-stp_10.42.42.5(pid=12690): stdout: | (launched: 2022-12-10_13:18:04.532071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:05.971234 run osmo-stp_10.42.42.5(pid=12690): stderr: | [0;m[38;5;43m20221210131804703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131804703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131804703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131804704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131804704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131804704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131804704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:06.096850 run osmo-stp_10.42.42.5(pid=12690): stdout: | (launched: 2022-12-10_13:18:04.532071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:06.216441 run osmo-stp_10.42.42.5(pid=12690): stderr: | [0;m[38;5;43m20221210131804703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131804703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131804703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131804704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131804704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131804704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131804704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:06.359587 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12690): Process ended prematurely: osmo-stp_10.42.42.5(pid=12690) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12690)] [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:18:06.368483 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:18:06.395149 run osmo-hlr_10.42.42.2(pid=12687): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12687)] 13:18:06.442729 run osmo-hlr_10.42.42.2(pid=12687): stdout: | (launched: 2022-12-10_13:18:03.583879) 13:18:06.491948 run osmo-hlr_10.42.42.2(pid=12687): stderr: | [0;m[1;31m20221210131803757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131803758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131803758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131803758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131803758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131803758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131803769 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131803778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131803779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131803779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:06.560337 run osmo-msc_10.42.42.6(pid=12693): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12693)] 13:18:06.607925 run osmo-msc_10.42.42.6(pid=12693): stdout: | (launched: 2022-12-10_13:18:05.491376) 13:18:06.657118 run osmo-msc_10.42.42.6(pid=12693): stderr: | [0;m[38;5;43m20221210131805763 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131805763 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb3ec8b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131805764 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131805764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131805764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131805765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131805766 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131805767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131805767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131805767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:18:06.706693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12686): Terminating (SIGTERM) 13:18:06.746192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12689): Terminating (SIGTERM) 13:18:06.785594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12692): Terminating (SIGTERM) 13:18:06.825464 --- ParallelTerminationStrategy: PID 12686 died... 13:18:06.844314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12686): Terminated: ok {rc=0} 13:18:06.888260 --- ParallelTerminationStrategy: PID 12689 died... 13:18:06.906708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12689): Terminated: ok {rc=0} 13:18:06.950480 --- ParallelTerminationStrategy: PID 12692 died... 13:18:06.968943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12692): Terminated: ok {rc=0} 13:18:07.054607 bus /sierra_3: Setting Powered False 13:18:08.152586 bus /sierra_3: Setting Powered False 13:18:09.267048 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:18:10.411904 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:18:10.423442 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:18:10.495879 tst mo_mt_call_osmux.py: using LAC 28661 13:18:10.621375 tst mo_mt_call_osmux.py: using RAC 101 13:18:10.739717 tst mo_mt_call_osmux.py: using CellId 28661 13:18:10.856641 tst mo_mt_call_osmux.py: using BVCI 28662 13:18:10.967095 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:18:10.978207 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:18:10.989130 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:18:11.000644 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:18:11.012326 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:18:11.023913 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:18:11.142634 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:18:11.265779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:11.759958 run create_hlr_db(pid=12695): Launched 13:18:11.889168 bus /sierra_2: Setting Powered False 13:18:12.952075 run create_hlr_db(pid=12695): Terminated: ok {rc=0} 13:18:13.375922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12697): Launched 13:18:13.672883 run osmo-hlr_10.42.42.2(pid=12698): Launched 13:18:13.787400 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:14.313941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12700): Launched 13:18:14.611810 run osmo-stp_10.42.42.5(pid=12701): Launched 13:18:14.726415 run osmo-msc_10.42.42.6: Starting osmo-msc 13:18:15.283109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12703): Launched 13:18:15.581349 run osmo-msc_10.42.42.6(pid=12704): Launched 13:18:15.750630 run osmo-stp_10.42.42.5(pid=12701): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12701)] 13:18:15.892317 run osmo-stp_10.42.42.5(pid=12701): stdout: | (launched: 2022-12-10_13:18:14.557404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:16.100189 run osmo-stp_10.42.42.5(pid=12701): stderr: | [0;m[38;5;43m20221210131814729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131814729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131814729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131814729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131814730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131814730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131814730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:16.230619 run osmo-stp_10.42.42.5(pid=12701): stdout: | (launched: 2022-12-10_13:18:14.557404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:16.354771 run osmo-stp_10.42.42.5(pid=12701): stderr: | [0;m[38;5;43m20221210131814729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131814729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131814729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131814729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131814730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131814730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131814730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:16.501813 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12701): Process ended prematurely: osmo-stp_10.42.42.5(pid=12701) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12701)] [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:18:16.511478 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:18:16.541331 run osmo-hlr_10.42.42.2(pid=12698): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12698)] 13:18:16.591522 run osmo-hlr_10.42.42.2(pid=12698): stdout: | (launched: 2022-12-10_13:18:13.619059) 13:18:16.643282 run osmo-hlr_10.42.42.2(pid=12698): stderr: | [0;m[1;31m20221210131813793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131813793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131813793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131813793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131813793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131813794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131813808 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131813817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131813817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131813817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:16.714864 run osmo-msc_10.42.42.6(pid=12704): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12704)] 13:18:16.764846 run osmo-msc_10.42.42.6(pid=12704): stdout: | (launched: 2022-12-10_13:18:15.526813) 13:18:16.816421 run osmo-msc_10.42.42.6(pid=12704): stderr: | [0;m[38;5;43m20221210131815797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131815797 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4df36f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131815797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131815797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131815797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131815797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131815799 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131815799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131815800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131815800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:18:16.868312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12697): Terminating (SIGTERM) 13:18:16.910748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12700): Terminating (SIGTERM) 13:18:16.952762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12703): Terminating (SIGTERM) 13:18:16.995219 --- ParallelTerminationStrategy: PID 12697 died... 13:18:17.014640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12697): Terminated: ok {rc=0} 13:18:17.063030 --- ParallelTerminationStrategy: PID 12700 died... 13:18:17.082568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12700): Terminated: ok {rc=0} 13:18:17.129402 --- ParallelTerminationStrategy: PID 12703 died... 13:18:17.148506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12703): Terminated: ok {rc=0} 13:18:17.235134 bus /sierra_3: Setting Powered False 13:18:18.332682 bus /sierra_3: Setting Powered False 13:18:19.449023 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:18:20.696227 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:18:20.703170 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:18:20.735767 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:18:20.762619 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:18:20.814988 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:18:20.848214 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:18:20.875325 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:18:21.431426 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:18:21.483743 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:18:21.495100 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:18:21.573529 tst mo_mt_call.py: using LAC 28662 13:18:21.700631 tst mo_mt_call.py: using RAC 102 13:18:21.825193 tst mo_mt_call.py: using CellId 28662 13:18:21.954480 tst mo_mt_call.py: using BVCI 28663 13:18:22.071649 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:18:22.082998 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:18:22.094194 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:18:22.105407 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:18:22.116600 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:18:22.127979 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:18:22.247792 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:18:22.362613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:22.824902 run create_hlr_db(pid=12709): Launched 13:18:22.940073 bus /sierra_2: Setting Powered False 13:18:24.000209 run create_hlr_db(pid=12709): Terminated: ok {rc=0} 13:18:24.415316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12711): Launched 13:18:24.712475 run osmo-hlr_10.42.42.2(pid=12712): Launched 13:18:24.826606 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:25.341315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12714): Launched 13:18:25.639038 run osmo-stp_10.42.42.5(pid=12715): Launched 13:18:25.753818 run osmo-msc_10.42.42.6: Starting osmo-msc 13:18:26.294914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12717): Launched 13:18:26.592779 run osmo-msc_10.42.42.6(pid=12718): Launched 13:18:26.760769 run osmo-stp_10.42.42.5(pid=12715): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12715)] 13:18:26.887855 run osmo-stp_10.42.42.5(pid=12715): stdout: | (launched: 2022-12-10_13:18:25.584752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:27.015464 run osmo-stp_10.42.42.5(pid=12715): stderr: | [0;m[38;5;43m20221210131825754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131825754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131825754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131825754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131825755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131825755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131825755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:27.140383 run osmo-stp_10.42.42.5(pid=12715): stdout: | (launched: 2022-12-10_13:18:25.584752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:27.259324 run osmo-stp_10.42.42.5(pid=12715): stderr: | [0;m[38;5;43m20221210131825754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131825754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131825754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131825754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131825755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131825755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131825755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:27.401673 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12715): Process ended prematurely: osmo-stp_10.42.42.5(pid=12715) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12715)] [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:18:27.410571 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:18:27.437210 run osmo-hlr_10.42.42.2(pid=12712): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12712)] 13:18:27.484904 run osmo-hlr_10.42.42.2(pid=12712): stdout: | (launched: 2022-12-10_13:18:24.658061) 13:18:27.534182 run osmo-hlr_10.42.42.2(pid=12712): stderr: | [0;m[1;31m20221210131824834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131824834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131824834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131824834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131824834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131824834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131824845 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131824854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131824854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131824854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:27.602316 run osmo-msc_10.42.42.6(pid=12718): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12718)] 13:18:27.649674 run osmo-msc_10.42.42.6(pid=12718): stdout: | (launched: 2022-12-10_13:18:26.538482) 13:18:27.698834 run osmo-msc_10.42.42.6(pid=12718): stderr: | [0;m[38;5;43m20221210131826811 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131826811 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f803f3b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131826811 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131826812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131826812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131826813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131826814 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131826815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131826815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131826815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:18:27.748001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12711): Terminating (SIGTERM) 13:18:27.787285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12714): Terminating (SIGTERM) 13:18:27.826714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12717): Terminating (SIGTERM) 13:18:27.866311 --- ParallelTerminationStrategy: PID 12711 died... 13:18:27.885011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12711): Terminated: ok {rc=0} 13:18:27.929836 --- ParallelTerminationStrategy: PID 12714 died... 13:18:27.948365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12714): Terminated: ok {rc=0} 13:18:27.992523 --- ParallelTerminationStrategy: PID 12717 died... 13:18:28.011022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12717): Terminated: ok {rc=0} 13:18:28.094038 bus /sierra_3: Setting Powered False 13:18:29.191353 bus /sierra_3: Setting Powered False 13:18:30.306384 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:18:31.452578 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:18:31.465693 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:18:31.538178 tst mo_mt_call_osmux.py: using LAC 28663 13:18:31.666388 tst mo_mt_call_osmux.py: using RAC 103 13:18:31.793795 tst mo_mt_call_osmux.py: using CellId 28663 13:18:31.915161 tst mo_mt_call_osmux.py: using BVCI 28664 13:18:32.028088 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:18:32.040153 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:18:32.052048 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:18:32.064416 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:18:32.077849 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:18:32.090317 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:18:32.207327 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:18:32.329370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:32.795258 run create_hlr_db(pid=12720): Launched 13:18:32.909336 bus /sierra_2: Setting Powered False 13:18:33.969441 run create_hlr_db(pid=12720): Terminated: ok {rc=0} 13:18:34.406232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12722): Launched 13:18:34.724544 run osmo-hlr_10.42.42.2(pid=12723): Launched 13:18:34.847169 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:35.401819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12725): Launched 13:18:35.720470 run osmo-stp_10.42.42.5(pid=12726): Launched 13:18:35.841908 run osmo-msc_10.42.42.6: Starting osmo-msc 13:18:36.418382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12728): Launched 13:18:36.736565 run osmo-msc_10.42.42.6(pid=12729): Launched 13:18:36.915137 run osmo-stp_10.42.42.5(pid=12726): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12726)] 13:18:37.049524 run osmo-stp_10.42.42.5(pid=12726): stdout: | (launched: 2022-12-10_13:18:35.662618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:37.185289 run osmo-stp_10.42.42.5(pid=12726): stderr: | [0;m[38;5;43m20221210131835854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131835855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131835855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131835855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131835858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131835858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131835858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:37.320057 run osmo-stp_10.42.42.5(pid=12726): stdout: | (launched: 2022-12-10_13:18:35.662618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:37.447000 run osmo-stp_10.42.42.5(pid=12726): stderr: | [0;m[38;5;43m20221210131835854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131835855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131835855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131835855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131835858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131835858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131835858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:37.598744 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12726): Process ended prematurely: osmo-stp_10.42.42.5(pid=12726) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12726)] [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:18:37.608153 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:18:37.635621 run osmo-hlr_10.42.42.2(pid=12723): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12723)] 13:18:37.685087 run osmo-hlr_10.42.42.2(pid=12723): stdout: | (launched: 2022-12-10_13:18:34.666821) 13:18:37.735884 run osmo-hlr_10.42.42.2(pid=12723): stderr: | [0;m[1;31m20221210131834863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131834863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131834863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131834863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131834863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131834863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131834876 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131834884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131834884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131834884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:37.806658 run osmo-msc_10.42.42.6(pid=12729): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12729)] 13:18:37.856081 run osmo-msc_10.42.42.6(pid=12729): stdout: | (launched: 2022-12-10_13:18:36.678757) 13:18:37.906863 run osmo-msc_10.42.42.6(pid=12729): stderr: | [0;m[38;5;43m20221210131837001 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131837002 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f50d9a7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131837002 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131837002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131837002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131837002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131837004 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131837004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131837004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131837004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:18:37.958012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12722): Terminating (SIGTERM) 13:18:37.998848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12725): Terminating (SIGTERM) 13:18:38.039704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12728): Terminating (SIGTERM) 13:18:38.081127 --- ParallelTerminationStrategy: PID 12722 died... 13:18:38.100929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12722): Terminated: ok {rc=0} 13:18:38.146448 --- ParallelTerminationStrategy: PID 12725 died... 13:18:38.165659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12725): Terminated: ok {rc=0} 13:18:38.210858 --- ParallelTerminationStrategy: PID 12728 died... 13:18:38.230203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12728): Terminated: ok {rc=0} 13:18:38.316613 bus /sierra_3: Setting Powered False 13:18:39.411716 bus /sierra_3: Setting Powered False 13:18:40.525863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:18:41.769225 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:18:41.775560 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:18:41.808144 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:18:41.834056 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:18:41.885870 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:18:41.918921 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:18:41.944705 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:18:42.492625 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:18:42.541162 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:18:42.551952 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:18:42.619405 tst mo_mt_call.py: using LAC 28664 13:18:42.742711 tst mo_mt_call.py: using RAC 104 13:18:42.860284 tst mo_mt_call.py: using CellId 28664 13:18:42.977045 tst mo_mt_call.py: using BVCI 28665 13:18:43.086312 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:18:43.097176 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:18:43.107878 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:18:43.119199 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:18:43.130368 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:18:43.141344 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:18:43.258113 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:18:43.375899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:43.840082 run create_hlr_db(pid=12734): Launched 13:18:43.954107 bus /sierra_2: Setting Powered False 13:18:45.014164 run create_hlr_db(pid=12734): Terminated: ok {rc=0} 13:18:45.452776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12736): Launched 13:18:45.772063 run osmo-hlr_10.42.42.2(pid=12737): Launched 13:18:45.980249 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:46.576118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12739): Launched 13:18:46.905424 run osmo-stp_10.42.42.5(pid=12740): Launched 13:18:47.068449 run osmo-msc_10.42.42.6: Starting osmo-msc 13:18:47.746476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12742): Launched 13:18:48.066586 run osmo-msc_10.42.42.6(pid=12743): Launched 13:18:48.244314 run osmo-stp_10.42.42.5(pid=12740): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12740)] 13:18:48.379833 run osmo-stp_10.42.42.5(pid=12740): stdout: | (launched: 2022-12-10_13:18:46.836398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:48.515454 run osmo-stp_10.42.42.5(pid=12740): stderr: | [0;m[38;5;43m20221210131847206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131847207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131847207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131847207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131847208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131847208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131847208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:48.649763 run osmo-stp_10.42.42.5(pid=12740): stdout: | (launched: 2022-12-10_13:18:46.836398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:48.776499 run osmo-stp_10.42.42.5(pid=12740): stderr: | [0;m[38;5;43m20221210131847206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131847207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131847207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131847207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131847208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131847208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131847208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:48.928509 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12740): Process ended prematurely: osmo-stp_10.42.42.5(pid=12740) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12740)] [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:18:48.938165 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:18:48.965687 run osmo-hlr_10.42.42.2(pid=12737): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12737)] 13:18:49.015846 run osmo-hlr_10.42.42.2(pid=12737): stdout: | (launched: 2022-12-10_13:18:45.714262) 13:18:49.067196 run osmo-hlr_10.42.42.2(pid=12737): stderr: | [0;m[1;31m20221210131845924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131845924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131845924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131845924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131845924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131845924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131845943 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131845960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131845960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131845960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:49.138633 run osmo-msc_10.42.42.6(pid=12743): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12743)] 13:18:49.188696 run osmo-msc_10.42.42.6(pid=12743): stdout: | (launched: 2022-12-10_13:18:48.008629) 13:18:49.240064 run osmo-msc_10.42.42.6(pid=12743): stderr: | [0;m[38;5;43m20221210131848331 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131848331 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f87c422ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131848331 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131848331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131848331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131848331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131848333 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131848333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131848334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131848334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:18:49.291739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12736): Terminating (SIGTERM) 13:18:49.333185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12739): Terminating (SIGTERM) 13:18:49.374590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12742): Terminating (SIGTERM) 13:18:49.416050 --- ParallelTerminationStrategy: PID 12736 died... 13:18:49.435780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12736): Terminated: ok {rc=0} 13:18:49.481635 --- ParallelTerminationStrategy: PID 12739 died... 13:18:49.500874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12739): Terminated: ok {rc=0} 13:18:49.546757 --- ParallelTerminationStrategy: PID 12742 died... 13:18:49.566032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12742): Terminated: ok {rc=0} 13:18:49.652930 bus /sierra_3: Setting Powered False 13:18:50.750182 bus /sierra_3: Setting Powered False 13:18:51.864518 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:18:53.005392 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:18:53.016845 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:18:53.084225 tst mo_mt_call_osmux.py: using LAC 28665 13:18:53.201931 tst mo_mt_call_osmux.py: using RAC 105 13:18:53.325560 tst mo_mt_call_osmux.py: using CellId 28665 13:18:53.452649 tst mo_mt_call_osmux.py: using BVCI 28666 13:18:53.569106 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:18:53.580546 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:18:53.591873 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:18:53.603076 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:18:53.614507 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:18:53.625671 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:18:53.746102 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:18:53.861870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:54.326482 run create_hlr_db(pid=12745): Launched 13:18:54.440722 bus /sierra_2: Setting Powered False 13:18:55.501144 run create_hlr_db(pid=12745): Terminated: ok {rc=0} 13:18:55.917274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12747): Launched 13:18:56.216552 run osmo-hlr_10.42.42.2(pid=12748): Launched 13:18:56.332195 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:56.863607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12750): Launched 13:18:57.162404 run osmo-stp_10.42.42.5(pid=12751): Launched 13:18:57.276602 run osmo-msc_10.42.42.6: Starting osmo-msc 13:18:57.815844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12753): Launched 13:18:58.114419 run osmo-msc_10.42.42.6(pid=12754): Launched 13:18:58.281569 run osmo-stp_10.42.42.5(pid=12751): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12751)] 13:18:58.408782 run osmo-stp_10.42.42.5(pid=12751): stdout: | (launched: 2022-12-10_13:18:57.107462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:58.535654 run osmo-stp_10.42.42.5(pid=12751): stderr: | [0;m[38;5;43m20221210131857277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131857277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131857277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131857277 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131857278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131857278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131857278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:58.659523 run osmo-stp_10.42.42.5(pid=12751): stdout: | (launched: 2022-12-10_13:18:57.107462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:58.777639 run osmo-stp_10.42.42.5(pid=12751): stderr: | [0;m[38;5;43m20221210131857277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131857277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131857277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131857277 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131857278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131857278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131857278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:58.919694 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12751): Process ended prematurely: osmo-stp_10.42.42.5(pid=12751) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12751)] [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:18:58.928536 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:18:58.955014 run osmo-hlr_10.42.42.2(pid=12748): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12748)] 13:18:59.002133 run osmo-hlr_10.42.42.2(pid=12748): stdout: | (launched: 2022-12-10_13:18:56.161849) 13:18:59.050749 run osmo-hlr_10.42.42.2(pid=12748): stderr: | [0;m[1;31m20221210131856336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131856336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131856336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131856336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131856336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131856336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131856353 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131856364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131856364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131856364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:59.118701 run osmo-msc_10.42.42.6(pid=12754): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12754)] 13:18:59.165748 run osmo-msc_10.42.42.6(pid=12754): stdout: | (launched: 2022-12-10_13:18:58.058283) 13:18:59.214261 run osmo-msc_10.42.42.6(pid=12754): stderr: | [0;m[38;5;43m20221210131858330 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131858330 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2505648c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131858330 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131858330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131858331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131858331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131858333 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131858333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131858334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131858334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:18:59.263460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12747): Terminating (SIGTERM) 13:18:59.302324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12750): Terminating (SIGTERM) 13:18:59.341165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12753): Terminating (SIGTERM) 13:18:59.380463 --- ParallelTerminationStrategy: PID 12747 died... 13:18:59.399092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12747): Terminated: ok {rc=0} 13:18:59.442706 --- ParallelTerminationStrategy: PID 12750 died... 13:18:59.460905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12750): Terminated: ok {rc=0} 13:18:59.504131 --- ParallelTerminationStrategy: PID 12753 died... 13:18:59.522259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12753): Terminated: ok {rc=0} 13:18:59.606027 bus /sierra_3: Setting Powered False 13:19:00.705259 bus /sierra_3: Setting Powered False 13:19:01.821911 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:19:03.062825 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:19:03.069326 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:19:03.101647 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:19:03.127791 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:19:03.179096 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:19:03.211119 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:19:03.237272 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:19:03.787232 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:19:03.835829 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:19:03.846845 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:19:03.913740 tst mo_mt_call.py: using LAC 28666 13:19:04.041335 tst mo_mt_call.py: using RAC 106 13:19:04.169119 tst mo_mt_call.py: using CellId 28666 13:19:04.296735 tst mo_mt_call.py: using BVCI 28667 13:19:04.413888 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:19:04.425292 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:19:04.436422 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:19:04.447759 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:19:04.459034 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:19:04.470434 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:19:04.584734 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:19:04.704787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:05.200621 run create_hlr_db(pid=12760): Launched 13:19:05.331128 bus /sierra_2: Setting Powered False 13:19:06.394646 run create_hlr_db(pid=12760): Terminated: ok {rc=0} 13:19:06.820744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12762): Launched 13:19:07.119484 run osmo-hlr_10.42.42.2(pid=12763): Launched 13:19:07.234137 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:07.765812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12765): Launched 13:19:08.063938 run osmo-stp_10.42.42.5(pid=12766): Launched 13:19:08.178131 run osmo-msc_10.42.42.6: Starting osmo-msc 13:19:08.718265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12768): Launched 13:19:09.016916 run osmo-msc_10.42.42.6(pid=12769): Launched 13:19:09.184330 run osmo-stp_10.42.42.5(pid=12766): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12766)] 13:19:09.311474 run osmo-stp_10.42.42.5(pid=12766): stdout: | (launched: 2022-12-10_13:19:08.008873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:09.439390 run osmo-stp_10.42.42.5(pid=12766): stderr: | [0;m[38;5;43m20221210131908179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131908179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131908179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131908180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131908180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131908180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131908180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:09.563933 run osmo-stp_10.42.42.5(pid=12766): stdout: | (launched: 2022-12-10_13:19:08.008873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:09.682715 run osmo-stp_10.42.42.5(pid=12766): stderr: | [0;m[38;5;43m20221210131908179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131908179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131908179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131908180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131908180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131908180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131908180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:09.824747 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12766): Process ended prematurely: osmo-stp_10.42.42.5(pid=12766) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12766)] [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:19:09.833767 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:19:09.860612 run osmo-hlr_10.42.42.2(pid=12763): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12763)] 13:19:09.907911 run osmo-hlr_10.42.42.2(pid=12763): stdout: | (launched: 2022-12-10_13:19:07.065527) 13:19:09.957015 run osmo-hlr_10.42.42.2(pid=12763): stderr: | [0;m[1;31m20221210131907239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131907239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131907239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131907239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131907239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131907239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131907252 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131907262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131907262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131907263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:10.024995 run osmo-msc_10.42.42.6(pid=12769): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12769)] 13:19:10.072108 run osmo-msc_10.42.42.6(pid=12769): stdout: | (launched: 2022-12-10_13:19:08.962488) 13:19:10.121134 run osmo-msc_10.42.42.6(pid=12769): stderr: | [0;m[38;5;43m20221210131909235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131909236 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0aa8895c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131909236 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131909236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131909236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131909236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131909238 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131909238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131909239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131909239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:19:10.170430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12762): Terminating (SIGTERM) 13:19:10.209358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12765): Terminating (SIGTERM) 13:19:10.248750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12768): Terminating (SIGTERM) 13:19:10.288267 --- ParallelTerminationStrategy: PID 12762 died... 13:19:10.306884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12762): Terminated: ok {rc=0} 13:19:10.350667 --- ParallelTerminationStrategy: PID 12765 died... 13:19:10.368834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12765): Terminated: ok {rc=0} 13:19:10.412164 --- ParallelTerminationStrategy: PID 12768 died... 13:19:10.430523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12768): Terminated: ok {rc=0} 13:19:10.515021 bus /sierra_3: Setting Powered False 13:19:11.612113 bus /sierra_3: Setting Powered False 13:19:12.723008 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:19:13.868832 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:19:13.880838 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:19:13.950800 tst mo_mt_call_osmux.py: using LAC 28667 13:19:14.077822 tst mo_mt_call_osmux.py: using RAC 107 13:19:14.205730 tst mo_mt_call_osmux.py: using CellId 28667 13:19:14.333977 tst mo_mt_call_osmux.py: using BVCI 28668 13:19:14.452321 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:19:14.463839 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:19:14.475102 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:19:14.486359 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:19:14.497697 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:19:14.508891 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:19:14.627730 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:19:14.745441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:15.207462 run create_hlr_db(pid=12771): Launched 13:19:15.322987 bus /sierra_2: Setting Powered False 13:19:16.398353 run create_hlr_db(pid=12771): Terminated: ok {rc=0} 13:19:16.887541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12773): Launched 13:19:17.206688 run osmo-hlr_10.42.42.2(pid=12774): Launched 13:19:17.334688 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:17.887073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12776): Launched 13:19:18.205334 run osmo-stp_10.42.42.5(pid=12777): Launched 13:19:18.327291 run osmo-msc_10.42.42.6: Starting osmo-msc 13:19:18.905425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12779): Launched 13:19:19.224287 run osmo-msc_10.42.42.6(pid=12780): Launched 13:19:19.402999 run osmo-stp_10.42.42.5(pid=12777): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12777)] 13:19:19.537872 run osmo-stp_10.42.42.5(pid=12777): stdout: | (launched: 2022-12-10_13:19:18.147417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:19.672300 run osmo-stp_10.42.42.5(pid=12777): stderr: | [0;m[38;5;43m20221210131918338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131918338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131918338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131918338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131918339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131918339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131918339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:19.807144 run osmo-stp_10.42.42.5(pid=12777): stdout: | (launched: 2022-12-10_13:19:18.147417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:19.933770 run osmo-stp_10.42.42.5(pid=12777): stderr: | [0;m[38;5;43m20221210131918338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131918338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131918338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131918338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131918339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131918339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131918339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:20.085127 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12777): Process ended prematurely: osmo-stp_10.42.42.5(pid=12777) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12777)] [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:19:20.094704 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:19:20.122203 run osmo-hlr_10.42.42.2(pid=12774): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12774)] 13:19:20.171493 run osmo-hlr_10.42.42.2(pid=12774): stdout: | (launched: 2022-12-10_13:19:17.147344) 13:19:20.222674 run osmo-hlr_10.42.42.2(pid=12774): stderr: | [0;m[1;31m20221210131917346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131917346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131917346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131917346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131917346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131917346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131917358 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131917367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131917367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131917367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:20.293911 run osmo-msc_10.42.42.6(pid=12780): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12780)] 13:19:20.343877 run osmo-msc_10.42.42.6(pid=12780): stdout: | (launched: 2022-12-10_13:19:19.166237) 13:19:20.395637 run osmo-msc_10.42.42.6(pid=12780): stderr: | [0;m[38;5;43m20221210131919489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131919489 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2a173e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131919489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131919489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131919489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131919490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131919491 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131919492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131919492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131919492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:19:20.447001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12773): Terminating (SIGTERM) 13:19:20.487871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12776): Terminating (SIGTERM) 13:19:20.528649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12779): Terminating (SIGTERM) 13:19:20.570168 --- ParallelTerminationStrategy: PID 12773 died... 13:19:20.589993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12773): Terminated: ok {rc=0} 13:19:20.635536 --- ParallelTerminationStrategy: PID 12776 died... 13:19:20.655080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12776): Terminated: ok {rc=0} 13:19:20.700194 --- ParallelTerminationStrategy: PID 12779 died... 13:19:20.719572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12779): Terminated: ok {rc=0} 13:19:20.804892 bus /sierra_3: Setting Powered False 13:19:21.902804 bus /sierra_3: Setting Powered False 13:19:23.019204 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:19:24.268786 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:19:24.275762 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:19:24.308261 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:19:24.335785 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:19:24.387859 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:19:24.420607 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:19:24.447635 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:19:24.999179 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:19:25.050273 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:19:25.061833 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:19:25.130670 tst mo_mt_call.py: using LAC 28668 13:19:25.257957 tst mo_mt_call.py: using RAC 108 13:19:25.385005 tst mo_mt_call.py: using CellId 28668 13:19:25.509909 tst mo_mt_call.py: using BVCI 28669 13:19:25.627720 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:19:25.639063 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:19:25.650285 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:19:25.661603 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:19:25.672836 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:19:25.683974 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:19:25.802120 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:19:25.919122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:26.384401 run create_hlr_db(pid=12786): Launched 13:19:26.500360 bus /sierra_2: Setting Powered False 13:19:27.560154 run create_hlr_db(pid=12786): Terminated: ok {rc=0} 13:19:27.976258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12788): Launched 13:19:28.275255 run osmo-hlr_10.42.42.2(pid=12789): Launched 13:19:28.389806 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:28.919918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12791): Launched 13:19:29.217428 run osmo-stp_10.42.42.5(pid=12792): Launched 13:19:29.332671 run osmo-msc_10.42.42.6: Starting osmo-msc 13:19:29.875986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12794): Launched 13:19:30.173984 run osmo-msc_10.42.42.6(pid=12795): Launched 13:19:30.340879 run osmo-stp_10.42.42.5(pid=12792): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12792)] 13:19:30.467959 run osmo-stp_10.42.42.5(pid=12792): stdout: | (launched: 2022-12-10_13:19:29.163044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:30.594993 run osmo-stp_10.42.42.5(pid=12792): stderr: | [0;m[38;5;43m20221210131929334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131929334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131929334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131929335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131929335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131929335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131929335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:30.719281 run osmo-stp_10.42.42.5(pid=12792): stdout: | (launched: 2022-12-10_13:19:29.163044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:30.838342 run osmo-stp_10.42.42.5(pid=12792): stderr: | [0;m[38;5;43m20221210131929334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131929334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131929334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131929335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131929335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131929335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131929335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:30.983004 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12792): Process ended prematurely: osmo-stp_10.42.42.5(pid=12792) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12792)] [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:19:30.992747 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:19:31.021325 run osmo-hlr_10.42.42.2(pid=12789): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12789)] 13:19:31.070130 run osmo-hlr_10.42.42.2(pid=12789): stdout: | (launched: 2022-12-10_13:19:28.220828) 13:19:31.120432 run osmo-hlr_10.42.42.2(pid=12789): stderr: | [0;m[1;31m20221210131928396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131928396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131928396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131928396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131928396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131928396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131928408 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131928417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131928417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131928417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:31.190530 run osmo-msc_10.42.42.6(pid=12795): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12795)] 13:19:31.239257 run osmo-msc_10.42.42.6(pid=12795): stdout: | (launched: 2022-12-10_13:19:30.118982) 13:19:31.289950 run osmo-msc_10.42.42.6(pid=12795): stderr: | [0;m[38;5;43m20221210131930390 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131930391 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7184279c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131930391 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131930391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131930391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131930391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131930395 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131930395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131930396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131930396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:19:31.347921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12788): Terminating (SIGTERM) 13:19:31.402436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12791): Terminating (SIGTERM) 13:19:31.459104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12794): Terminating (SIGTERM) 13:19:31.517271 --- ParallelTerminationStrategy: PID 12788 died... 13:19:31.542963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12788): Terminated: ok {rc=0} 13:19:31.602601 --- ParallelTerminationStrategy: PID 12791 died... 13:19:31.629118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12791): Terminated: ok {rc=0} 13:19:31.688601 --- ParallelTerminationStrategy: PID 12794 died... 13:19:31.711899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12794): Terminated: ok {rc=0} 13:19:31.822268 bus /sierra_3: Setting Powered False 13:19:32.934280 bus /sierra_3: Setting Powered False 13:19:34.050426 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:19:35.195281 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:19:35.206988 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:19:35.275260 tst mo_mt_call_osmux.py: using LAC 28669 13:19:35.392847 tst mo_mt_call_osmux.py: using RAC 109 13:19:35.513656 tst mo_mt_call_osmux.py: using CellId 28669 13:19:35.631843 tst mo_mt_call_osmux.py: using BVCI 28670 13:19:35.740548 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:19:35.751527 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:19:35.762333 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:19:35.773422 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:19:35.784571 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:19:35.795954 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:19:35.910099 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:19:36.027837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:36.523593 run create_hlr_db(pid=12797): Launched 13:19:36.653502 bus /sierra_2: Setting Powered False 13:19:37.716761 run create_hlr_db(pid=12797): Terminated: ok {rc=0} 13:19:38.159576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12799): Launched 13:19:38.478860 run osmo-hlr_10.42.42.2(pid=12800): Launched 13:19:38.600659 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:39.153646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12802): Launched 13:19:39.472770 run osmo-stp_10.42.42.5(pid=12803): Launched 13:19:39.594710 run osmo-msc_10.42.42.6: Starting osmo-msc 13:19:40.170506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12805): Launched 13:19:40.488753 run osmo-msc_10.42.42.6(pid=12806): Launched 13:19:40.666552 run osmo-stp_10.42.42.5(pid=12803): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12803)] 13:19:40.801155 run osmo-stp_10.42.42.5(pid=12803): stdout: | (launched: 2022-12-10_13:19:39.414686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:40.937454 run osmo-stp_10.42.42.5(pid=12803): stderr: | [0;m[38;5;43m20221210131939608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131939608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131939608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131939609 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131939609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131939609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131939609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:41.071483 run osmo-stp_10.42.42.5(pid=12803): stdout: | (launched: 2022-12-10_13:19:39.414686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:41.197776 run osmo-stp_10.42.42.5(pid=12803): stderr: | [0;m[38;5;43m20221210131939608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131939608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131939608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131939609 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131939609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131939609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131939609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:41.349737 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12803): Process ended prematurely: osmo-stp_10.42.42.5(pid=12803) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12803)] [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:19:41.359346 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:19:41.387112 run osmo-hlr_10.42.42.2(pid=12800): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12800)] 13:19:41.436344 run osmo-hlr_10.42.42.2(pid=12800): stdout: | (launched: 2022-12-10_13:19:38.420902) 13:19:41.487331 run osmo-hlr_10.42.42.2(pid=12800): stderr: | [0;m[1;31m20221210131938618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131938618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131938618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131938618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131938618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131938618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131938630 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131938639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131938639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131938639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:41.558640 run osmo-msc_10.42.42.6(pid=12806): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12806)] 13:19:41.608038 run osmo-msc_10.42.42.6(pid=12806): stdout: | (launched: 2022-12-10_13:19:40.430745) 13:19:41.659055 run osmo-msc_10.42.42.6(pid=12806): stderr: | [0;m[38;5;43m20221210131940754 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131940754 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f12f4759c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131940754 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131940754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131940754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131940754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131940756 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131940756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131940757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131940757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:19:41.710081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12799): Terminating (SIGTERM) 13:19:41.751029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12802): Terminating (SIGTERM) 13:19:41.791932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12805): Terminating (SIGTERM) 13:19:41.833336 --- ParallelTerminationStrategy: PID 12799 died... 13:19:41.853207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12799): Terminated: ok {rc=0} 13:19:41.899535 --- ParallelTerminationStrategy: PID 12802 died... 13:19:41.919004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12802): Terminated: ok {rc=0} 13:19:41.964565 --- ParallelTerminationStrategy: PID 12805 died... 13:19:41.983937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12805): Terminated: ok {rc=0} 13:19:42.070187 bus /sierra_3: Setting Powered False 13:19:43.169242 bus /sierra_3: Setting Powered False 13:19:44.284467 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:19:45.530431 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:19:45.536676 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:19:45.569465 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:19:45.595435 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:19:45.647330 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:19:45.679052 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:19:45.704845 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:19:46.283744 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:19:46.361111 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:19:46.376562 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:19:46.457062 tst mo_mt_call.py: using LAC 28670 13:19:46.586551 tst mo_mt_call.py: using RAC 110 13:19:46.714624 tst mo_mt_call.py: using CellId 28670 13:19:46.843175 tst mo_mt_call.py: using BVCI 28671 13:19:46.955434 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:19:46.967542 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:19:46.979444 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:19:46.991918 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:19:47.004895 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:19:47.017673 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:19:47.134821 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:19:47.251589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:47.717520 run create_hlr_db(pid=12811): Launched 13:19:47.831781 bus /sierra_2: Setting Powered False 13:19:48.890962 run create_hlr_db(pid=12811): Terminated: ok {rc=0} 13:19:49.325293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12813): Launched 13:19:49.644621 run osmo-hlr_10.42.42.2(pid=12814): Launched 13:19:49.766971 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:50.318374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12816): Launched 13:19:50.636768 run osmo-stp_10.42.42.5(pid=12817): Launched 13:19:50.758831 run osmo-msc_10.42.42.6: Starting osmo-msc 13:19:51.336794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12819): Launched 13:19:51.655913 run osmo-msc_10.42.42.6(pid=12820): Launched 13:19:51.834817 run osmo-stp_10.42.42.5(pid=12817): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12817)] 13:19:51.969320 run osmo-stp_10.42.42.5(pid=12817): stdout: | (launched: 2022-12-10_13:19:50.578992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:52.104232 run osmo-stp_10.42.42.5(pid=12817): stderr: | [0;m[38;5;43m20221210131950770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131950770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131950770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131950770 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131950773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131950773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131950773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:52.238791 run osmo-stp_10.42.42.5(pid=12817): stdout: | (launched: 2022-12-10_13:19:50.578992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:52.366363 run osmo-stp_10.42.42.5(pid=12817): stderr: | [0;m[38;5;43m20221210131950770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210131950770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210131950770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210131950770 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210131950773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210131950773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210131950773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:52.518553 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12817): Process ended prematurely: osmo-stp_10.42.42.5(pid=12817) [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12817)] [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:19:52.528051 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:19:52.555940 run osmo-hlr_10.42.42.2(pid=12814): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12814)] 13:19:52.605900 run osmo-hlr_10.42.42.2(pid=12814): stdout: | (launched: 2022-12-10_13:19:49.586833) 13:19:52.657618 run osmo-hlr_10.42.42.2(pid=12814): stderr: | [0;m[1;31m20221210131949783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131949783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131949783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131949783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131949783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131949783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210131949795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210131949803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210131949803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210131949804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:52.729616 run osmo-msc_10.42.42.6(pid=12820): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12820)] 13:19:52.779301 run osmo-msc_10.42.42.6(pid=12820): stdout: | (launched: 2022-12-10_13:19:51.598114) 13:19:52.830264 run osmo-msc_10.42.42.6(pid=12820): stderr: | [0;m[38;5;43m20221210131951921 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210131951921 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe5d78f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210131951921 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210131951921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210131951922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210131951922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210131951923 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210131951924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210131951924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210131951924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:19:52.881567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12813): Terminating (SIGTERM) 13:19:52.922826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12816): Terminating (SIGTERM) 13:19:52.964466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12819): Terminating (SIGTERM) 13:19:53.006336 --- ParallelTerminationStrategy: PID 12813 died... 13:19:53.026042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12813): Terminated: ok {rc=0} 13:19:53.072205 --- ParallelTerminationStrategy: PID 12816 died... 13:19:53.091706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12816): Terminated: ok {rc=0} 13:19:53.137906 --- ParallelTerminationStrategy: PID 12819 died... 13:19:53.157375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12819): Terminated: ok {rc=0} 13:19:53.243899 bus /sierra_3: Setting Powered False 13:19:54.340068 bus /sierra_3: Setting Powered False 13:19:55.454972 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:19:56.599763 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:19:56.611441 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:19:56.679274 tst mo_mt_call_osmux.py: using LAC 28671 13:19:56.798905 tst mo_mt_call_osmux.py: using RAC 111 13:19:56.919409 tst mo_mt_call_osmux.py: using CellId 28671 13:19:57.045680 tst mo_mt_call_osmux.py: using BVCI 28672 13:19:57.163040 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:19:57.174805 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:19:57.186514 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:19:57.198298 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:19:57.210199 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:19:57.221851 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:19:57.339530 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:19:57.454863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:57.920399 run create_hlr_db(pid=12822): Launched 13:19:58.035161 bus /sierra_2: Setting Powered False 13:19:59.094759 run create_hlr_db(pid=12822): Terminated: ok {rc=0} 13:19:59.531193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12824): Launched 13:19:59.851099 run osmo-hlr_10.42.42.2(pid=12825): Launched 13:19:59.973685 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:00.527997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12827): Launched 13:20:00.862854 run osmo-stp_10.42.42.5(pid=12828): Launched 13:20:01.137451 run osmo-msc_10.42.42.6: Starting osmo-msc 13:20:01.784089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12833): Launched 13:20:02.139296 run osmo-msc_10.42.42.6(pid=12834): Launched 13:20:02.488433 run osmo-stp_10.42.42.5(pid=12828): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12828)] 13:20:02.625960 run osmo-stp_10.42.42.5(pid=12828): stdout: | (launched: 2022-12-10_13:20:00.788851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:02.760562 run osmo-stp_10.42.42.5(pid=12828): stderr: | [0;m[38;5;43m20221210132001044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132001044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132001045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132001045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132001046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132001046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132001046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:02.893767 run osmo-stp_10.42.42.5(pid=12828): stdout: | (launched: 2022-12-10_13:20:00.788851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:03.021191 run osmo-stp_10.42.42.5(pid=12828): stderr: | [0;m[38;5;43m20221210132001044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132001044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132001045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132001045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132001046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132001046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132001046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:03.173681 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12828): Process ended prematurely: osmo-stp_10.42.42.5(pid=12828) [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12828)] [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:20:03.183430 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 13:20:03.211128 run osmo-hlr_10.42.42.2(pid=12825): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12825)] 13:20:03.261109 run osmo-hlr_10.42.42.2(pid=12825): stdout: | (launched: 2022-12-10_13:19:59.793485) 13:20:03.312341 run osmo-hlr_10.42.42.2(pid=12825): stderr: | [0;m[1;31m20221210131959989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210131959989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210131959989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210131959989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210131959989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210131959989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132000002 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132000010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132000010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132000010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:03.383985 run osmo-msc_10.42.42.6(pid=12834): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12834)] 13:20:03.433536 run osmo-msc_10.42.42.6(pid=12834): stdout: | (launched: 2022-12-10_13:20:02.075599) 13:20:03.484686 run osmo-msc_10.42.42.6(pid=12834): stderr: | [0;m[38;5;43m20221210132002494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132002494 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f70bc38bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132002495 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132002495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132002495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132002495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132002497 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132002497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132002497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132002497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:20:03.536114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12824): Terminating (SIGTERM) 13:20:03.577664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12827): Terminating (SIGTERM) 13:20:03.619259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12833): Terminating (SIGTERM) 13:20:03.661242 --- ParallelTerminationStrategy: PID 12824 died... 13:20:03.681106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12824): Terminated: ok {rc=0} 13:20:03.727211 --- ParallelTerminationStrategy: PID 12827 died... 13:20:03.746744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12827): Terminated: ok {rc=0} 13:20:03.793331 --- ParallelTerminationStrategy: PID 12833 died... 13:20:03.812672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12833): Terminated: ok {rc=0} 13:20:03.900139 bus /sierra_3: Setting Powered False 13:20:04.997435 bus /sierra_3: Setting Powered False 13:20:06.110040 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:20:07.354804 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:20:07.360456 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:20:07.392877 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:20:07.418945 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:20:07.474414 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:20:07.507768 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:20:07.534834 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:20:08.082700 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:20:08.133740 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:20:08.145116 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:20:08.214890 tst mo_mt_call.py: using LAC 28672 13:20:08.341987 tst mo_mt_call.py: using RAC 112 13:20:08.469656 tst mo_mt_call.py: using CellId 28672 13:20:08.596054 tst mo_mt_call.py: using BVCI 28673 13:20:08.712268 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:20:08.723564 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:20:08.734554 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:20:08.745676 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:20:08.756623 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:20:08.767702 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:20:08.881508 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:20:08.995804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:09.460617 run create_hlr_db(pid=12840): Launched 13:20:09.576564 bus /sierra_2: Setting Powered False 13:20:10.636906 run create_hlr_db(pid=12840): Terminated: ok {rc=0} 13:20:11.071616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12842): Launched 13:20:11.391403 run osmo-hlr_10.42.42.2(pid=12843): Launched 13:20:11.513466 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:12.065449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12845): Launched 13:20:12.385478 run osmo-stp_10.42.42.5(pid=12846): Launched 13:20:12.508029 run osmo-msc_10.42.42.6: Starting osmo-msc 13:20:13.086826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12848): Launched 13:20:13.404297 run osmo-msc_10.42.42.6(pid=12849): Launched 13:20:13.584875 run osmo-stp_10.42.42.5(pid=12846): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12846)] 13:20:13.719577 run osmo-stp_10.42.42.5(pid=12846): stdout: | (launched: 2022-12-10_13:20:12.327037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:13.854894 run osmo-stp_10.42.42.5(pid=12846): stderr: | [0;m[38;5;43m20221210132012518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132012518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132012519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132012519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132012519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132012519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132012520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:13.988837 run osmo-stp_10.42.42.5(pid=12846): stdout: | (launched: 2022-12-10_13:20:12.327037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:14.115671 run osmo-stp_10.42.42.5(pid=12846): stderr: | [0;m[38;5;43m20221210132012518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132012518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132012519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132012519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132012519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132012519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132012520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:14.267400 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12846): Process ended prematurely: osmo-stp_10.42.42.5(pid=12846) [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12846)] [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:20:14.277000 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:20:14.304482 run osmo-hlr_10.42.42.2(pid=12843): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12843)] 13:20:14.354803 run osmo-hlr_10.42.42.2(pid=12843): stdout: | (launched: 2022-12-10_13:20:11.332888) 13:20:14.406214 run osmo-hlr_10.42.42.2(pid=12843): stderr: | [0;m[1;31m20221210132011531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132011531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132011531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132011531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132011531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132011531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132011544 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132011554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132011554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132011554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:14.477624 run osmo-msc_10.42.42.6(pid=12849): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12849)] 13:20:14.527464 run osmo-msc_10.42.42.6(pid=12849): stdout: | (launched: 2022-12-10_13:20:13.346210) 13:20:14.578584 run osmo-msc_10.42.42.6(pid=12849): stderr: | [0;m[38;5;43m20221210132013669 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132013669 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdcca049c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132013669 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132013669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132013669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132013669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132013671 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132013671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132013671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132013672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:20:14.630078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12842): Terminating (SIGTERM) 13:20:14.671015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12845): Terminating (SIGTERM) 13:20:14.711944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12848): Terminating (SIGTERM) 13:20:14.753351 --- ParallelTerminationStrategy: PID 12842 died... 13:20:14.773146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12842): Terminated: ok {rc=0} 13:20:14.819301 --- ParallelTerminationStrategy: PID 12845 died... 13:20:14.838796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12845): Terminated: ok {rc=0} 13:20:14.884755 --- ParallelTerminationStrategy: PID 12848 died... 13:20:14.904294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12848): Terminated: ok {rc=0} 13:20:14.991425 bus /sierra_3: Setting Powered False 13:20:16.091743 bus /sierra_3: Setting Powered False 13:20:17.227658 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:20:18.373944 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:20:18.385345 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:20:18.453368 tst mo_mt_call_osmux.py: using LAC 28673 13:20:18.573348 tst mo_mt_call_osmux.py: using RAC 113 13:20:18.693452 tst mo_mt_call_osmux.py: using CellId 28673 13:20:18.813350 tst mo_mt_call_osmux.py: using BVCI 28674 13:20:18.922416 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:20:18.933353 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:20:18.943897 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:20:18.954755 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:20:18.965687 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:20:18.976461 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:20:19.090764 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:20:19.206914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:19.671473 run create_hlr_db(pid=12851): Launched 13:20:19.786104 bus /sierra_2: Setting Powered False 13:20:20.846144 run create_hlr_db(pid=12851): Terminated: ok {rc=0} 13:20:21.283059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12853): Launched 13:20:21.603042 run osmo-hlr_10.42.42.2(pid=12854): Launched 13:20:21.725432 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:22.275523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12856): Launched 13:20:22.594809 run osmo-stp_10.42.42.5(pid=12857): Launched 13:20:22.716818 run osmo-msc_10.42.42.6: Starting osmo-msc 13:20:23.299740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12859): Launched 13:20:23.621006 run osmo-msc_10.42.42.6(pid=12860): Launched 13:20:23.801206 run osmo-stp_10.42.42.5(pid=12857): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12857)] 13:20:23.937344 run osmo-stp_10.42.42.5(pid=12857): stdout: | (launched: 2022-12-10_13:20:22.536514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:24.073260 run osmo-stp_10.42.42.5(pid=12857): stderr: | [0;m[38;5;43m20221210132022730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132022730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132022730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132022731 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132022731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132022731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132022731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:24.208087 run osmo-stp_10.42.42.5(pid=12857): stdout: | (launched: 2022-12-10_13:20:22.536514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:24.335586 run osmo-stp_10.42.42.5(pid=12857): stderr: | [0;m[38;5;43m20221210132022730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132022730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132022730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132022731 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132022731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132022731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132022731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:24.488806 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12857): Process ended prematurely: osmo-stp_10.42.42.5(pid=12857) [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12857)] [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:20:24.498415 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:20:24.526405 run osmo-hlr_10.42.42.2(pid=12854): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12854)] 13:20:24.576514 run osmo-hlr_10.42.42.2(pid=12854): stdout: | (launched: 2022-12-10_13:20:21.545130) 13:20:24.628358 run osmo-hlr_10.42.42.2(pid=12854): stderr: | [0;m[1;31m20221210132021742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132021742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132021742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132021742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132021742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132021742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132021754 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132021762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132021763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132021763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:24.700359 run osmo-msc_10.42.42.6(pid=12860): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12860)] 13:20:24.750144 run osmo-msc_10.42.42.6(pid=12860): stdout: | (launched: 2022-12-10_13:20:23.562934) 13:20:24.801428 run osmo-msc_10.42.42.6(pid=12860): stderr: | [0;m[38;5;43m20221210132023887 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132023887 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdcf4dc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132023887 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132023888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132023888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132023888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132023890 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132023890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132023890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132023890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:20:24.853179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12853): Terminating (SIGTERM) 13:20:24.894423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12856): Terminating (SIGTERM) 13:20:24.935781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12859): Terminating (SIGTERM) 13:20:24.977499 --- ParallelTerminationStrategy: PID 12853 died... 13:20:24.997432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12853): Terminated: ok {rc=0} 13:20:25.043356 --- ParallelTerminationStrategy: PID 12856 died... 13:20:25.062929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12856): Terminated: ok {rc=0} 13:20:25.108909 --- ParallelTerminationStrategy: PID 12859 died... 13:20:25.128516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12859): Terminated: ok {rc=0} 13:20:25.215186 bus /sierra_3: Setting Powered False 13:20:26.315089 bus /sierra_3: Setting Powered False 13:20:27.432520 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:20:28.675361 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:20:28.681249 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:20:28.713949 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 13:20:28.740197 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 13:20:28.791003 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:20:28.822586 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 13:20:28.848665 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 13:20:29.400442 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 13:20:29.448879 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:20:29.459988 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:20:29.510215 tst mo_mt_call.py: using LAC 28674 13:20:29.628676 tst mo_mt_call.py: using RAC 114 13:20:29.746414 tst mo_mt_call.py: using CellId 28674 13:20:29.866417 tst mo_mt_call.py: using BVCI 28675 13:20:29.978188 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:20:29.989434 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:20:30.000305 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:20:30.011514 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:20:30.022862 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:20:30.034054 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:20:30.152046 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:20:30.267164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:30.731075 run create_hlr_db(pid=12865): Launched 13:20:30.859650 bus /sierra_2: Setting Powered False 13:20:31.927482 run create_hlr_db(pid=12865): Terminated: ok {rc=0} 13:20:32.390456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12867): Launched 13:20:32.710726 run osmo-hlr_10.42.42.2(pid=12868): Launched 13:20:32.831893 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:33.383607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12870): Launched 13:20:33.702866 run osmo-stp_10.42.42.5(pid=12871): Launched 13:20:33.825170 run osmo-msc_10.42.42.6: Starting osmo-msc 13:20:34.403723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12873): Launched 13:20:34.723136 run osmo-msc_10.42.42.6(pid=12874): Launched 13:20:34.892452 run osmo-stp_10.42.42.5(pid=12871): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12871)] 13:20:35.021118 run osmo-stp_10.42.42.5(pid=12871): stdout: | (launched: 2022-12-10_13:20:33.644905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:35.150146 run osmo-stp_10.42.42.5(pid=12871): stderr: | [0;m[38;5;43m20221210132033839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132033839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132033839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132033839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132033840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132033840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132033840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:35.275533 run osmo-stp_10.42.42.5(pid=12871): stdout: | (launched: 2022-12-10_13:20:33.644905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:35.394896 run osmo-stp_10.42.42.5(pid=12871): stderr: | [0;m[38;5;43m20221210132033839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132033839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132033839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132033839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132033840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132033840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132033840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:35.537869 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12871): Process ended prematurely: osmo-stp_10.42.42.5(pid=12871) [trial-2375↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12871)] [trial-2375↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 13:20:35.546716 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:20:35.573031 run osmo-hlr_10.42.42.2(pid=12868): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12868)] 13:20:35.619987 run osmo-hlr_10.42.42.2(pid=12868): stdout: | (launched: 2022-12-10_13:20:32.652577) 13:20:35.668575 run osmo-hlr_10.42.42.2(pid=12868): stderr: | [0;m[1;31m20221210132032852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132032852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132032852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132032852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132032852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132032852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132032866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132032875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132032876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132032876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:35.736712 run osmo-msc_10.42.42.6(pid=12874): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12874)] 13:20:35.783735 run osmo-msc_10.42.42.6(pid=12874): stdout: | (launched: 2022-12-10_13:20:34.665329) 13:20:35.832370 run osmo-msc_10.42.42.6(pid=12874): stderr: | [0;m[38;5;43m20221210132034938 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132034938 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f99cf12bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132034938 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132034938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132034938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132034939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132034940 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132034941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132034941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132034941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:20:35.881315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12867): Terminating (SIGTERM) 13:20:35.920305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12870): Terminating (SIGTERM) 13:20:35.959310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12873): Terminating (SIGTERM) 13:20:35.998731 --- ParallelTerminationStrategy: PID 12867 died... 13:20:36.018010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12867): Terminated: ok {rc=0} 13:20:36.061705 --- ParallelTerminationStrategy: PID 12870 died... 13:20:36.079764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12870): Terminated: ok {rc=0} 13:20:36.123411 --- ParallelTerminationStrategy: PID 12873 died... 13:20:36.141647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12873): Terminated: ok {rc=0} 13:20:36.226387 bus /sierra_3: Setting Powered False 13:20:37.325168 bus /sierra_3: Setting Powered False 13:20:38.437096 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 13:20:39.584778 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:20:39.597255 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:20:39.650343 tst mo_mt_call_osmux.py: using LAC 28675 13:20:39.778038 tst mo_mt_call_osmux.py: using RAC 115 13:20:39.907294 tst mo_mt_call_osmux.py: using CellId 28675 13:20:40.033724 tst mo_mt_call_osmux.py: using BVCI 28676 13:20:40.152662 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:20:40.164631 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:20:40.176267 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:20:40.188144 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:20:40.200052 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:20:40.211955 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:20:40.327475 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:20:40.444724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:40.940582 run create_hlr_db(pid=12876): Launched 13:20:41.070739 bus /sierra_2: Setting Powered False 13:20:42.134346 run create_hlr_db(pid=12876): Terminated: ok {rc=0} 13:20:42.562378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12878): Launched 13:20:42.861632 run osmo-hlr_10.42.42.2(pid=12879): Launched 13:20:42.976631 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:43.499761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12881): Launched 13:20:43.798924 run osmo-stp_10.42.42.5(pid=12882): Launched 13:20:43.913954 run osmo-msc_10.42.42.6: Starting osmo-msc 13:20:44.455925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12884): Launched 13:20:44.755298 run osmo-msc_10.42.42.6(pid=12885): Launched 13:20:44.923632 run osmo-stp_10.42.42.5(pid=12882): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12882)] 13:20:45.050921 run osmo-stp_10.42.42.5(pid=12882): stdout: | (launched: 2022-12-10_13:20:43.744289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:45.178689 run osmo-stp_10.42.42.5(pid=12882): stderr: | [0;m[38;5;43m20221210132043911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132043911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132043911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132043912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132043914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132043914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132043914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:45.304484 run osmo-stp_10.42.42.5(pid=12882): stdout: | (launched: 2022-12-10_13:20:43.744289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:45.423712 run osmo-stp_10.42.42.5(pid=12882): stderr: | [0;m[38;5;43m20221210132043911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132043911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132043911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132043912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132043914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132043914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132043914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:45.566607 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12882): Process ended prematurely: osmo-stp_10.42.42.5(pid=12882) [trial-2375↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12882)] [trial-2375↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 13:20:45.575328 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:20:45.601616 run osmo-hlr_10.42.42.2(pid=12879): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12879)] 13:20:45.649164 run osmo-hlr_10.42.42.2(pid=12879): stdout: | (launched: 2022-12-10_13:20:42.806802) 13:20:45.697994 run osmo-hlr_10.42.42.2(pid=12879): stderr: | [0;m[1;31m20221210132042983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132042983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132042983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132042983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132042984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132042984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132042996 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132043005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132043005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132043005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:45.766248 run osmo-msc_10.42.42.6(pid=12885): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12885)] 13:20:45.813471 run osmo-msc_10.42.42.6(pid=12885): stdout: | (launched: 2022-12-10_13:20:44.700300) 13:20:45.877636 run osmo-msc_10.42.42.6(pid=12885): stderr: | [0;m[38;5;43m20221210132044971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132044971 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2af83c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132044971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132044971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132044971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132044972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132044974 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132044974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132044975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132044975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:20:45.953907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12878): Terminating (SIGTERM) 13:20:46.002792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12881): Terminating (SIGTERM) 13:20:46.048511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12884): Terminating (SIGTERM) 13:20:46.096556 --- ParallelTerminationStrategy: PID 12878 died... 13:20:46.117171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12878): Terminated: ok {rc=0} 13:20:46.168168 --- ParallelTerminationStrategy: PID 12881 died... 13:20:46.188352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12881): Terminated: ok {rc=0} 13:20:46.237431 --- ParallelTerminationStrategy: PID 12884 died... 13:20:46.257840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12884): Terminated: ok {rc=0} 13:20:46.349420 bus /sierra_3: Setting Powered False 13:20:47.451914 bus /sierra_3: Setting Powered False 13:20:48.566527 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 emergency:trx-umtrx --------------------------------------------------------------------- 13:20:49.815048 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:20:49.819784 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:20:49.852715 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 13:20:49.879792 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 13:20:49.964537 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:20:49.997667 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 13:20:50.024903 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 13:20:50.608906 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2375 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 13:20:50.614279 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:20:50.625481 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 13:20:50.674485 tst emergency_mo_mt_call.py: using LAC 28676 13:20:50.799763 tst emergency_mo_mt_call.py: using RAC 116 13:20:50.922463 tst emergency_mo_mt_call.py: using CellId 28676 13:20:51.046830 tst emergency_mo_mt_call.py: using BVCI 28677 13:20:51.160471 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:20:51.171452 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:20:51.182295 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:20:51.193053 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:20:51.203775 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:20:51.214509 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:20:51.328373 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:20:51.446314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:51.903145 run create_hlr_db(pid=12890): Launched 13:20:52.016175 bus /sierra_2: Setting Powered False 13:20:53.075527 run create_hlr_db(pid=12890): Terminated: ok {rc=0} 13:20:53.486960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12892): Launched 13:20:53.780882 run osmo-hlr_10.42.42.2(pid=12893): Launched 13:20:53.893484 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:54.400277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12895): Launched 13:20:54.694951 run osmo-stp_10.42.42.5(pid=12896): Launched 13:20:54.817617 tst emergency_mo_mt_call.py: using MSISDN 7755 13:20:54.968270 run osmo-msc_10.42.42.6: Starting osmo-msc 13:20:55.498320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12898): Launched 13:20:55.794829 run osmo-msc_10.42.42.6(pid=12899): Launched 13:20:55.960869 run osmo-stp_10.42.42.5(pid=12896): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12896)] 13:20:56.087267 run osmo-stp_10.42.42.5(pid=12896): stdout: | (launched: 2022-12-10_13:20:54.641089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:56.213642 run osmo-stp_10.42.42.5(pid=12896): stderr: | [0;m[38;5;43m20221210132054809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132054809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132054810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132054810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132054811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132054811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132054811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:56.336860 run osmo-stp_10.42.42.5(pid=12896): stdout: | (launched: 2022-12-10_13:20:54.641089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:56.454604 run osmo-stp_10.42.42.5(pid=12896): stderr: | [0;m[38;5;43m20221210132054809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132054809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132054810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132054810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132054811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132054811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132054811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:56.595306 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12896): Process ended prematurely: osmo-stp_10.42.42.5(pid=12896) [trial-2375↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12896)] [trial-2375↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 13:20:56.603498 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 13:20:56.629586 run osmo-hlr_10.42.42.2(pid=12893): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12893)] 13:20:56.676722 run osmo-hlr_10.42.42.2(pid=12893): stdout: | (launched: 2022-12-10_13:20:53.727135) 13:20:56.725556 run osmo-hlr_10.42.42.2(pid=12893): stderr: | [0;m[1;31m20221210132053903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132053903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132053903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132053903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132053903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132053903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132053933 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132053943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132053943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132053943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:56.793773 run osmo-msc_10.42.42.6(pid=12899): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12899)] 13:20:56.840929 run osmo-msc_10.42.42.6(pid=12899): stdout: | (launched: 2022-12-10_13:20:55.739748) 13:20:56.889817 run osmo-msc_10.42.42.6(pid=12899): stderr: | [0;m[38;5;43m20221210132056010 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132056011 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3634c22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132056011 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132056011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132056011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132056011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132056013 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132056014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132056014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132056014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:20:56.939013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12892): Terminating (SIGTERM) 13:20:56.978009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12895): Terminating (SIGTERM) 13:20:57.017111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12898): Terminating (SIGTERM) 13:20:57.056893 --- ParallelTerminationStrategy: PID 12892 died... 13:20:57.076060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12892): Terminated: ok {rc=0} 13:20:57.119829 --- ParallelTerminationStrategy: PID 12895 died... 13:20:57.138105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12895): Terminated: ok {rc=0} 13:20:57.181605 --- ParallelTerminationStrategy: PID 12898 died... 13:20:57.199800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12898): Terminated: ok {rc=0} 13:20:57.284256 bus /sierra_3: Setting Powered False 13:20:58.381560 bus /sierra_3: Setting Powered False 13:20:59.495301 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 13:21:00.581452 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:21:00.592555 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 13:21:00.640333 tst emergency_preemptive_call.py: using LAC 28677 13:21:00.756879 tst emergency_preemptive_call.py: using RAC 117 13:21:00.874433 tst emergency_preemptive_call.py: using CellId 28677 13:21:01.007156 tst emergency_preemptive_call.py: using BVCI 28678 13:21:01.128146 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:21:01.139775 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:21:01.151321 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:21:01.164078 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:21:01.175991 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:21:01.187476 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:21:01.303190 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:21:01.445029 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:21:01.581163 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:21:01.729693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:02.222652 run create_hlr_db(pid=12901): Launched 13:21:02.368431 bus /sierra_2: Setting Powered False 13:21:03.431778 run create_hlr_db(pid=12901): Terminated: ok {rc=0} 13:21:03.854388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12903): Launched 13:21:04.149769 run osmo-hlr_10.42.42.2(pid=12904): Launched 13:21:04.261869 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:04.787998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12906): Launched 13:21:05.084014 run osmo-stp_10.42.42.5(pid=12907): Launched 13:21:05.205630 tst emergency_preemptive_call.py: using MSISDN 7756 13:21:05.356214 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:05.883949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12909): Launched 13:21:06.177468 run osmo-msc_10.42.42.6(pid=12910): Launched 13:21:06.343047 run osmo-stp_10.42.42.5(pid=12907): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12907)] 13:21:06.468899 run osmo-stp_10.42.42.5(pid=12907): stdout: | (launched: 2022-12-10_13:21:05.029113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:06.594525 run osmo-stp_10.42.42.5(pid=12907): stderr: | [0;m[38;5;43m20221210132105200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132105201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132105201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132105201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132105202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132105202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132105202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:06.718709 run osmo-stp_10.42.42.5(pid=12907): stdout: | (launched: 2022-12-10_13:21:05.029113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:06.836420 run osmo-stp_10.42.42.5(pid=12907): stderr: | [0;m[38;5;43m20221210132105200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132105201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132105201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132105201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132105202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132105202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132105202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:06.977519 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12907): Process ended prematurely: osmo-stp_10.42.42.5(pid=12907) [trial-2375↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12907)] [trial-2375↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 13:21:06.985717 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 13:21:07.011810 run osmo-hlr_10.42.42.2(pid=12904): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12904)] 13:21:07.059462 run osmo-hlr_10.42.42.2(pid=12904): stdout: | (launched: 2022-12-10_13:21:04.095481) 13:21:07.108448 run osmo-hlr_10.42.42.2(pid=12904): stderr: | [0;m[1;31m20221210132104273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132104273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132104273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132104273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132104273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132104273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132104286 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132104296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132104296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132104296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:07.177259 run osmo-msc_10.42.42.6(pid=12910): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12910)] 13:21:07.224668 run osmo-msc_10.42.42.6(pid=12910): stdout: | (launched: 2022-12-10_13:21:06.123498) 13:21:07.273360 run osmo-msc_10.42.42.6(pid=12910): stderr: | [0;m[38;5;43m20221210132106394 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132106395 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f60c8b3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132106395 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132106395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132106395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132106396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132106397 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132106398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132106398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132106398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:21:07.322394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12903): Terminating (SIGTERM) 13:21:07.361338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12906): Terminating (SIGTERM) 13:21:07.400435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12909): Terminating (SIGTERM) 13:21:07.439711 --- ParallelTerminationStrategy: PID 12903 died... 13:21:07.458450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12903): Terminated: ok {rc=0} 13:21:07.502026 --- ParallelTerminationStrategy: PID 12906 died... 13:21:07.520529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12906): Terminated: ok {rc=0} 13:21:07.564053 --- ParallelTerminationStrategy: PID 12909 died... 13:21:07.582306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12909): Terminated: ok {rc=0} 13:21:07.666282 bus /sierra_9: Setting Powered False 13:21:08.764892 bus /sierra_9: Setting Powered False 13:21:09.878912 bus /sierra_8: Setting Powered False 13:21:10.978594 bus /sierra_8: Setting Powered False 13:21:12.093062 bus /sierra_3: Setting Powered False 13:21:13.189293 bus /sierra_3: Setting Powered False 13:21:14.303300 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-umtrx --------------------------------------------------------------------- 13:21:15.577892 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:21:15.582716 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:21:15.614565 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 13:21:15.652603 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 13:21:15.737373 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:21:15.769444 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 13:21:15.807330 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 13:21:16.411217 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 13:21:16.486618 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:16.501049 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:21:16.561155 tst cs_paging_gprs_active.py: using LAC 28678 13:21:16.689885 tst cs_paging_gprs_active.py: using RAC 118 13:21:16.812483 tst cs_paging_gprs_active.py: using CellId 28678 13:21:16.940088 tst cs_paging_gprs_active.py: using BVCI 28679 13:21:17.060630 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:17.071624 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:17.083335 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:17.095986 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:17.107287 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:17.118512 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:17.131006 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:17.142474 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:17.154006 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:21:17.274601 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:21:17.395135 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:21:17.612473 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:21:17.933940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12918): Launched 13:21:18.213196 run iperf3-srv_10.42.42.10(pid=12919): Launched 13:21:18.333518 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:21:18.550337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:21:18.872301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12920): Launched 13:21:19.151788 run iperf3-srv_10.42.42.10(pid=12921): Launched 13:21:19.272093 tst cs_paging_gprs_active.py:38: start network... 13:21:19.489155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:19.987857 run create_hlr_db(pid=12922): Launched 13:21:20.118609 bus /sierra_2: Setting Powered False 13:21:21.179008 run create_hlr_db(pid=12922): Terminated: ok {rc=0} 13:21:21.624792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12924): Launched 13:21:21.949650 run osmo-hlr_10.42.42.2(pid=12925): Launched 13:21:22.076088 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:22.627803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12927): Launched 13:21:22.948704 run osmo-stp_10.42.42.5(pid=12928): Launched 13:21:23.071235 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:21:23.633076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12930): Launched 13:21:23.754876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:21:24.025558 run patchelf(pid=12931): Launched 13:21:24.203338 run osmo-stp_10.42.42.5(pid=12928): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12928)] 13:21:24.338794 run osmo-stp_10.42.42.5(pid=12928): stdout: | (launched: 2022-12-10_13:21:22.890247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:24.476634 run osmo-stp_10.42.42.5(pid=12928): stderr: | [0;m[38;5;43m20221210132123081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132123081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132123081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132123082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132123084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132123084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132123084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:24.613862 run osmo-stp_10.42.42.5(pid=12928): stdout: | (launched: 2022-12-10_13:21:22.890247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:24.745674 run osmo-stp_10.42.42.5(pid=12928): stderr: | [0;m[38;5;43m20221210132123081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132123081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132123081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132123082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132123084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132123084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132123084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:24.901798 run patchelf(pid=12931): Terminating (SIGINT) 13:21:25.082135 run patchelf(pid=12931): Terminated: ok {rc=0} 13:21:25.212334 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12928): Process ended prematurely: osmo-stp_10.42.42.5(pid=12928) [trial-2375↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12928)] [trial-2375↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 13:21:25.222257 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:21:25.250347 run osmo-hlr_10.42.42.2(pid=12925): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12925)] 13:21:25.299491 run osmo-hlr_10.42.42.2(pid=12925): stdout: | (launched: 2022-12-10_13:21:21.886927) 13:21:25.350081 run osmo-hlr_10.42.42.2(pid=12925): stderr: | [0;m[1;31m20221210132122093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132122093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132122093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132122093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132122094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132122095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132122108 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132122118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132122118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132122118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:25.401499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12918): Terminating (SIGTERM) 13:21:25.442608 run iperf3-srv_10.42.42.10(pid=12919): Terminating (SIGTERM) 13:21:25.483500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12920): Terminating (SIGTERM) 13:21:25.524506 run iperf3-srv_10.42.42.10(pid=12921): Terminating (SIGTERM) 13:21:25.565387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12924): Terminating (SIGTERM) 13:21:25.606418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12927): Terminating (SIGTERM) 13:21:25.647295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12930): Terminating (SIGTERM) 13:21:25.688413 --- ParallelTerminationStrategy: PID 12918 died... 13:21:25.708027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12918): Terminated: ok {rc=0} 13:21:25.753306 --- ParallelTerminationStrategy: PID 12919 died... 13:21:25.772322 run iperf3-srv_10.42.42.10(pid=12919): Terminated {rc=256} 13:21:25.817345 --- ParallelTerminationStrategy: PID 12920 died... 13:21:25.836440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12920): Terminated: ok {rc=0} 13:21:25.881853 --- ParallelTerminationStrategy: PID 12921 died... 13:21:25.901044 run iperf3-srv_10.42.42.10(pid=12921): Terminated {rc=256} 13:21:25.946043 --- ParallelTerminationStrategy: PID 12924 died... 13:21:25.965157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12924): Terminated: ok {rc=0} 13:21:26.010539 --- ParallelTerminationStrategy: PID 12927 died... 13:21:26.029769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12927): Terminated: ok {rc=0} 13:21:26.075067 --- ParallelTerminationStrategy: PID 12930 died... 13:21:26.094361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12930): Terminated: ok {rc=0} 13:21:26.180790 bus /gobi_0: Setting Powered False 13:21:27.279217 bus /gobi_0: Setting Powered False 13:21:28.395035 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx iperf3.py ---------------------------------------------- 13:21:29.539285 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:29.550377 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:21:29.604065 tst iperf3.py: using LAC 28679 13:21:29.722390 tst iperf3.py: using RAC 119 13:21:29.842517 tst iperf3.py: using CellId 28679 13:21:29.962608 tst iperf3.py: using BVCI 28680 13:21:30.074155 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:30.084576 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:30.094974 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:30.105537 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:30.115896 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:30.126263 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:30.136737 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:30.147231 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:30.157906 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:21:30.275795 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:21:30.494178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:21:30.815725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12932): Launched 13:21:31.113583 run iperf3-srv_10.42.42.10(pid=12933): Launched 13:21:31.246850 tst iperf3.py:8: start network... 13:21:31.458905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:31.955583 run create_hlr_db(pid=12934): Launched 13:21:32.077560 bus /gobi_6: Setting Powered False 13:21:33.137784 run create_hlr_db(pid=12934): Terminated: ok {rc=0} 13:21:33.577372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12936): Launched 13:21:33.897322 run osmo-hlr_10.42.42.2(pid=12937): Launched 13:21:34.019882 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:34.581074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12939): Launched 13:21:34.899515 run osmo-stp_10.42.42.5(pid=12940): Launched 13:21:35.021161 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:21:35.574069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12942): Launched 13:21:35.696360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:21:35.966640 run patchelf(pid=12943): Launched 13:21:36.144524 run osmo-stp_10.42.42.5(pid=12940): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12940)] 13:21:36.280031 run osmo-stp_10.42.42.5(pid=12940): stdout: | (launched: 2022-12-10_13:21:34.841634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:36.417966 run osmo-stp_10.42.42.5(pid=12940): stderr: | [0;m[38;5;43m20221210132135033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132135033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132135033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132135034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132135034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132135034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132135034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:36.556159 run osmo-stp_10.42.42.5(pid=12940): stdout: | (launched: 2022-12-10_13:21:34.841634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:36.687950 run osmo-stp_10.42.42.5(pid=12940): stderr: | [0;m[38;5;43m20221210132135033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132135033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132135033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132135034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132135034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132135034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132135034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:36.843918 run patchelf(pid=12943): Terminating (SIGINT) 13:21:37.024096 run patchelf(pid=12943): Terminated: ok {rc=0} 13:21:37.154199 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12940): Process ended prematurely: osmo-stp_10.42.42.5(pid=12940) [trial-2375↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12940)] [trial-2375↪gprs:trx-umtrx↪iperf3.py:8] 13:21:37.164116 tst iperf3.py:8: Test FAILED (7.7 sec) 13:21:37.192282 run osmo-hlr_10.42.42.2(pid=12937): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12937)] 13:21:37.241564 run osmo-hlr_10.42.42.2(pid=12937): stdout: | (launched: 2022-12-10_13:21:33.839015) 13:21:37.292409 run osmo-hlr_10.42.42.2(pid=12937): stderr: | [0;m[1;31m20221210132134037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132134037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132134037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132134037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132134037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132134037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132134049 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132134058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132134058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132134058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:37.343574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12932): Terminating (SIGTERM) 13:21:37.384607 run iperf3-srv_10.42.42.10(pid=12933): Terminating (SIGTERM) 13:21:37.425986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12936): Terminating (SIGTERM) 13:21:37.467201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12939): Terminating (SIGTERM) 13:21:37.508352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12942): Terminating (SIGTERM) 13:21:37.549980 --- ParallelTerminationStrategy: PID 12932 died... 13:21:37.569840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12932): Terminated: ok {rc=0} 13:21:37.615486 --- ParallelTerminationStrategy: PID 12933 died... 13:21:37.634898 run iperf3-srv_10.42.42.10(pid=12933): Terminated {rc=256} 13:21:37.680307 --- ParallelTerminationStrategy: PID 12936 died... 13:21:37.699716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12936): Terminated: ok {rc=0} 13:21:37.745094 --- ParallelTerminationStrategy: PID 12939 died... 13:21:37.764520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12939): Terminated: ok {rc=0} 13:21:37.809754 --- ParallelTerminationStrategy: PID 12942 died... 13:21:37.828859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12942): Terminated: ok {rc=0} 13:21:37.914975 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 13:21:39.065933 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:39.077720 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:21:39.124012 tst iperf3m4.py: using LAC 28680 13:21:39.244711 tst iperf3m4.py: using RAC 120 13:21:39.370710 tst iperf3m4.py: using CellId 28680 13:21:39.496698 tst iperf3m4.py: using BVCI 28681 13:21:39.613471 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:39.624562 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:39.635359 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:39.646068 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:39.656563 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:39.667199 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:39.678036 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:39.688533 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:39.699820 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:21:39.818392 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:21:39.945437 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:21:40.061202 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:21:40.180013 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:21:40.397050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:21:40.718885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12944): Launched 13:21:40.996679 run iperf3-srv_10.42.42.10(pid=12945): Launched 13:21:41.116758 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:21:41.332812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:21:41.653572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12946): Launched 13:21:41.931751 run iperf3-srv_10.42.42.10(pid=12947): Launched 13:21:42.051698 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:21:42.267475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:21:42.589639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12948): Launched 13:21:42.868773 run iperf3-srv_10.42.42.10(pid=12949): Launched 13:21:42.989233 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:21:43.205486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:21:43.528670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12950): Launched 13:21:43.807583 run iperf3-srv_10.42.42.10(pid=12951): Launched 13:21:43.927806 tst iperf3m4.py:8: start network... 13:21:44.143718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:44.642377 run create_hlr_db(pid=12952): Launched 13:21:44.771432 bus /gobi_6: Setting Powered False 13:21:45.838985 run create_hlr_db(pid=12952): Terminated: ok {rc=0} 13:21:46.355858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12954): Launched 13:21:46.689721 run osmo-hlr_10.42.42.2(pid=12955): Launched 13:21:46.888670 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:47.531451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12957): Launched 13:21:47.832861 run osmo-stp_10.42.42.5(pid=12958): Launched 13:21:47.947907 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:21:48.468661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12960): Launched 13:21:48.583748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:21:48.838673 run patchelf(pid=12961): Launched 13:21:49.006794 run osmo-stp_10.42.42.5(pid=12958): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12958)] 13:21:49.133973 run osmo-stp_10.42.42.5(pid=12958): stdout: | (launched: 2022-12-10_13:21:47.777933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:49.262856 run osmo-stp_10.42.42.5(pid=12958): stderr: | [0;m[38;5;43m20221210132147947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132147947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132147948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132147948 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132147949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132147949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132147949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:49.391560 run osmo-stp_10.42.42.5(pid=12958): stdout: | (launched: 2022-12-10_13:21:47.777933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:49.515231 run osmo-stp_10.42.42.5(pid=12958): stderr: | [0;m[38;5;43m20221210132147947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132147947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132147948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132147948 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132147949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132147949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132147949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:49.661407 run patchelf(pid=12961): Terminating (SIGINT) 13:21:49.830512 run patchelf(pid=12961): Terminated: ok {rc=0} 13:21:49.952196 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12958): Process ended prematurely: osmo-stp_10.42.42.5(pid=12958) [trial-2375↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12958)] [trial-2375↪gprs:trx-umtrx↪iperf3m4.py:8] 13:21:49.961631 tst iperf3m4.py:8: Test FAILED (10.9 sec) 13:21:49.988745 run osmo-hlr_10.42.42.2(pid=12955): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12955)] 13:21:50.035594 run osmo-hlr_10.42.42.2(pid=12955): stdout: | (launched: 2022-12-10_13:21:46.619721) 13:21:50.083986 run osmo-hlr_10.42.42.2(pid=12955): stderr: | [0;m[1;31m20221210132146985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132146985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132146985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132146985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132146986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132146986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132147009 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132147029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132147029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132147029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:50.132680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12944): Terminating (SIGTERM) 13:21:50.171732 run iperf3-srv_10.42.42.10(pid=12945): Terminating (SIGTERM) 13:21:50.210890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12946): Terminating (SIGTERM) 13:21:50.250193 run iperf3-srv_10.42.42.10(pid=12947): Terminating (SIGTERM) 13:21:50.289293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12948): Terminating (SIGTERM) 13:21:50.328514 run iperf3-srv_10.42.42.10(pid=12949): Terminating (SIGTERM) 13:21:50.367448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12950): Terminating (SIGTERM) 13:21:50.406529 run iperf3-srv_10.42.42.10(pid=12951): Terminating (SIGTERM) 13:21:50.445488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12954): Terminating (SIGTERM) 13:21:50.484501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12957): Terminating (SIGTERM) 13:21:50.523563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12960): Terminating (SIGTERM) 13:21:50.562916 --- ParallelTerminationStrategy: PID 12944 died... 13:21:50.581567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12944): Terminated: ok {rc=0} 13:21:50.625636 --- ParallelTerminationStrategy: PID 12945 died... 13:21:50.643544 run iperf3-srv_10.42.42.10(pid=12945): Terminated {rc=256} 13:21:50.686748 --- ParallelTerminationStrategy: PID 12946 died... 13:21:50.705014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12946): Terminated: ok {rc=0} 13:21:50.748186 --- ParallelTerminationStrategy: PID 12947 died... 13:21:50.766388 run iperf3-srv_10.42.42.10(pid=12947): Terminated {rc=256} 13:21:50.809568 --- ParallelTerminationStrategy: PID 12948 died... 13:21:50.827631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12948): Terminated: ok {rc=0} 13:21:50.871158 --- ParallelTerminationStrategy: PID 12949 died... 13:21:50.889269 run iperf3-srv_10.42.42.10(pid=12949): Terminated {rc=256} 13:21:50.932383 --- ParallelTerminationStrategy: PID 12950 died... 13:21:50.950583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12950): Terminated: ok {rc=0} 13:21:50.994596 --- ParallelTerminationStrategy: PID 12951 died... 13:21:51.012712 run iperf3-srv_10.42.42.10(pid=12951): Terminated {rc=256} 13:21:51.056496 --- ParallelTerminationStrategy: PID 12954 died... 13:21:51.074811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12954): Terminated: ok {rc=0} 13:21:51.118423 --- ParallelTerminationStrategy: PID 12957 died... 13:21:51.136734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12957): Terminated: ok {rc=0} 13:21:51.180115 --- ParallelTerminationStrategy: PID 12960 died... 13:21:51.198394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12960): Terminated: ok {rc=0} 13:21:51.282914 bus /gobi_4: Setting Powered False 13:21:52.381171 bus /gobi_4: Setting Powered False 13:21:53.493696 bus /gobi_1: Setting Powered False 13:21:54.588766 bus /gobi_1: Setting Powered False 13:21:55.703279 bus /gobi_0: Setting Powered False 13:21:56.801254 bus /gobi_0: Setting Powered False 13:21:57.917741 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx ping.py ---------------------------------------------- 13:21:59.018978 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:59.029965 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:21:59.077956 tst ping.py: using LAC 28681 13:21:59.204463 tst ping.py: using RAC 121 13:21:59.327475 tst ping.py: using CellId 28681 13:21:59.450365 tst ping.py: using BVCI 28682 13:21:59.565016 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:59.575870 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:59.586888 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:59.597647 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:59.608263 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:59.619016 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:59.629850 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:21:59.640477 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:21:59.754261 tst ping.py:19: start network... 13:21:59.952649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:00.409481 run create_hlr_db(pid=12962): Launched 13:22:00.523077 bus /gobi_6: Setting Powered False 13:22:01.608359 run create_hlr_db(pid=12962): Terminated: ok {rc=0} 13:22:02.105719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12964): Launched 13:22:02.428748 run osmo-hlr_10.42.42.2(pid=12965): Launched 13:22:02.549058 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:03.094544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12967): Launched 13:22:03.407946 run osmo-stp_10.42.42.5(pid=12968): Launched 13:22:03.528260 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:22:04.070031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12970): Launched 13:22:04.188687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:22:04.439087 run patchelf(pid=12971): Launched 13:22:04.603620 run osmo-stp_10.42.42.5(pid=12968): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12968)] 13:22:04.729188 run osmo-stp_10.42.42.5(pid=12968): stdout: | (launched: 2022-12-10_13:22:03.350792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:04.855895 run osmo-stp_10.42.42.5(pid=12968): stderr: | [0;m[38;5;43m20221210132203542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132203543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132203543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132203543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132203544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132203544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132203544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:04.982560 run osmo-stp_10.42.42.5(pid=12968): stdout: | (launched: 2022-12-10_13:22:03.350792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:05.104096 run osmo-stp_10.42.42.5(pid=12968): stderr: | [0;m[38;5;43m20221210132203542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132203543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132203543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132203543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132203544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132203544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132203544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:05.247857 run patchelf(pid=12971): Terminating (SIGINT) 13:22:05.413714 run patchelf(pid=12971): Terminated: ok {rc=0} 13:22:05.533557 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12968): Process ended prematurely: osmo-stp_10.42.42.5(pid=12968) [trial-2375↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12968)] [trial-2375↪gprs:trx-umtrx↪ping.py:22] 13:22:05.542295 tst ping.py:22: Test FAILED (6.5 sec) 13:22:05.569137 run osmo-hlr_10.42.42.2(pid=12965): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12965)] 13:22:05.616357 run osmo-hlr_10.42.42.2(pid=12965): stdout: | (launched: 2022-12-10_13:22:02.371334) 13:22:05.665076 run osmo-hlr_10.42.42.2(pid=12965): stderr: | [0;m[1;31m20221210132202569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132202569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132202569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132202569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132202569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132202569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132202586 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132202597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132202597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132202597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:05.714004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12964): Terminating (SIGTERM) 13:22:05.753194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12967): Terminating (SIGTERM) 13:22:05.792683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12970): Terminating (SIGTERM) 13:22:05.832163 --- ParallelTerminationStrategy: PID 12964 died... 13:22:05.850922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12964): Terminated: ok {rc=0} 13:22:05.894666 --- ParallelTerminationStrategy: PID 12967 died... 13:22:05.913010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12967): Terminated: ok {rc=0} 13:22:05.956832 --- ParallelTerminationStrategy: PID 12970 died... 13:22:05.975487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12970): Terminated: ok {rc=0} 13:22:06.057932 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 13:22:07.143939 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:22:07.155544 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:22:07.205834 tst ping_idle_ping.py: using LAC 28682 13:22:07.330802 tst ping_idle_ping.py: using RAC 122 13:22:07.447870 tst ping_idle_ping.py: using CellId 28682 13:22:07.564163 tst ping_idle_ping.py: using BVCI 28683 13:22:07.672094 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:22:07.682685 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:22:07.693271 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:22:07.703791 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:22:07.714394 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:22:07.724782 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:22:07.735351 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:22:07.745921 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:22:07.862929 tst ping_idle_ping.py:24: start network... 13:22:08.074753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:08.564543 run create_hlr_db(pid=12972): Launched 13:22:08.693734 bus /gobi_6: Setting Powered False 13:22:09.757171 run create_hlr_db(pid=12972): Terminated: ok {rc=0} 13:22:10.197337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12974): Launched 13:22:10.513480 run osmo-hlr_10.42.42.2(pid=12975): Launched 13:22:10.635097 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:11.181365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12977): Launched 13:22:11.496875 run osmo-stp_10.42.42.5(pid=12978): Launched 13:22:11.618381 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:22:12.163285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12980): Launched 13:22:12.283331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:22:12.549899 run patchelf(pid=12981): Launched 13:22:12.725782 run osmo-stp_10.42.42.5(pid=12978): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12978)] 13:22:12.859724 run osmo-stp_10.42.42.5(pid=12978): stdout: | (launched: 2022-12-10_13:22:11.439415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:12.994651 run osmo-stp_10.42.42.5(pid=12978): stderr: | [0;m[38;5;43m20221210132211631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132211631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132211631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132211632 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132211632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132211632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132211633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:13.129587 run osmo-stp_10.42.42.5(pid=12978): stdout: | (launched: 2022-12-10_13:22:11.439415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:13.259132 run osmo-stp_10.42.42.5(pid=12978): stderr: | [0;m[38;5;43m20221210132211631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132211631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132211631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132211632 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132211632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132211632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132211633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:13.412711 run patchelf(pid=12981): Terminating (SIGINT) 13:22:13.590842 run patchelf(pid=12981): Terminated: ok {rc=0} 13:22:13.718473 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12978): Process ended prematurely: osmo-stp_10.42.42.5(pid=12978) [trial-2375↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12978)] [trial-2375↪gprs:trx-umtrx↪ping_idle_ping.py:27] 13:22:13.727792 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:22:13.755389 run osmo-hlr_10.42.42.2(pid=12975): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12975)] 13:22:13.804524 run osmo-hlr_10.42.42.2(pid=12975): stdout: | (launched: 2022-12-10_13:22:10.455815) 13:22:13.855376 run osmo-hlr_10.42.42.2(pid=12975): stderr: | [0;m[1;31m20221210132210654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132210654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132210654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132210654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132210654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132210654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132210667 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132210676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132210676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132210676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:13.906735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12974): Terminating (SIGTERM) 13:22:13.948044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12977): Terminating (SIGTERM) 13:22:13.989445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12980): Terminating (SIGTERM) 13:22:14.031054 --- ParallelTerminationStrategy: PID 12974 died... 13:22:14.050893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12974): Terminated: ok {rc=0} 13:22:14.096622 --- ParallelTerminationStrategy: PID 12977 died... 13:22:14.116039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12977): Terminated: ok {rc=0} 13:22:14.161437 --- ParallelTerminationStrategy: PID 12980 died... 13:22:14.180592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12980): Terminated: ok {rc=0} 13:22:14.266731 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 13:22:15.562686 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:22:15.568193 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:22:15.601017 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:22:15.639649 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:22:15.725249 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:22:15.757919 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:22:15.796767 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:22:16.392308 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:22:16.445918 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:16.456824 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:22:16.507659 tst cs_paging_gprs_active.py: using LAC 28683 13:22:16.657151 tst cs_paging_gprs_active.py: using RAC 123 13:22:16.779327 tst cs_paging_gprs_active.py: using CellId 28683 13:22:16.911543 tst cs_paging_gprs_active.py: using BVCI 28684 13:22:17.031270 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:17.042901 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:17.055081 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:17.066714 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:17.078885 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:17.090781 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:17.102584 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:17.113955 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:17.125602 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:22:17.243221 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:22:17.362691 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:22:17.565282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:22:17.868315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12986): Launched 13:22:18.131261 run iperf3-srv_10.42.42.10(pid=12987): Launched 13:22:18.244715 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:22:18.447315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:22:18.749984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12988): Launched 13:22:19.013050 run iperf3-srv_10.42.42.10(pid=12989): Launched 13:22:19.126688 tst cs_paging_gprs_active.py:38: start network... 13:22:19.328385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:19.797179 run create_hlr_db(pid=12990): Launched 13:22:19.913950 bus /gobi_6: Setting Powered False 13:22:20.978072 run create_hlr_db(pid=12990): Terminated: ok {rc=0} 13:22:21.423612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12992): Launched 13:22:21.745270 run osmo-hlr_10.42.42.2(pid=12993): Launched 13:22:21.869091 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:22.422461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12995): Launched 13:22:22.744126 run osmo-stp_10.42.42.5(pid=12996): Launched 13:22:22.867648 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:22:23.423005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12998): Launched 13:22:23.546421 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:22:23.818247 run patchelf(pid=12999): Launched 13:22:23.996573 run osmo-stp_10.42.42.5(pid=12996): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12996)] 13:22:24.132471 run osmo-stp_10.42.42.5(pid=12996): stdout: | (launched: 2022-12-10_13:22:22.685863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:24.269911 run osmo-stp_10.42.42.5(pid=12996): stderr: | [0;m[38;5;43m20221210132222876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132222877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132222877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132222877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132222878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132222878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132222878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:24.407256 run osmo-stp_10.42.42.5(pid=12996): stdout: | (launched: 2022-12-10_13:22:22.685863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:24.539587 run osmo-stp_10.42.42.5(pid=12996): stderr: | [0;m[38;5;43m20221210132222876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132222877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132222877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132222877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132222878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132222878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132222878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:24.696108 run patchelf(pid=12999): Terminating (SIGINT) 13:22:24.876382 run patchelf(pid=12999): Terminated: ok {rc=0} 13:22:25.006894 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12996): Process ended prematurely: osmo-stp_10.42.42.5(pid=12996) [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12996)] [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:22:25.016826 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:22:25.045239 run osmo-hlr_10.42.42.2(pid=12993): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12993)] 13:22:25.094915 run osmo-hlr_10.42.42.2(pid=12993): stdout: | (launched: 2022-12-10_13:22:21.686892) 13:22:25.146447 run osmo-hlr_10.42.42.2(pid=12993): stderr: | [0;m[1;31m20221210132221884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132221884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132221884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132221884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132221884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132221884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132221897 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132221907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132221907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132221907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:25.198114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12986): Terminating (SIGTERM) 13:22:25.239007 run iperf3-srv_10.42.42.10(pid=12987): Terminating (SIGTERM) 13:22:25.279799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12988): Terminating (SIGTERM) 13:22:25.320881 run iperf3-srv_10.42.42.10(pid=12989): Terminating (SIGTERM) 13:22:25.361834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12992): Terminating (SIGTERM) 13:22:25.402888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12995): Terminating (SIGTERM) 13:22:25.444217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12998): Terminating (SIGTERM) 13:22:25.485510 --- ParallelTerminationStrategy: PID 12986 died... 13:22:25.505123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12986): Terminated: ok {rc=0} 13:22:25.550472 --- ParallelTerminationStrategy: PID 12987 died... 13:22:25.569795 run iperf3-srv_10.42.42.10(pid=12987): Terminated {rc=256} 13:22:25.615006 --- ParallelTerminationStrategy: PID 12988 died... 13:22:25.634171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12988): Terminated: ok {rc=0} 13:22:25.679310 --- ParallelTerminationStrategy: PID 12989 died... 13:22:25.698506 run iperf3-srv_10.42.42.10(pid=12989): Terminated {rc=256} 13:22:25.743540 --- ParallelTerminationStrategy: PID 12992 died... 13:22:25.762866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12992): Terminated: ok {rc=0} 13:22:25.808058 --- ParallelTerminationStrategy: PID 12995 died... 13:22:25.827335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12995): Terminated: ok {rc=0} 13:22:25.873152 --- ParallelTerminationStrategy: PID 12998 died... 13:22:25.892411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12998): Terminated: ok {rc=0} 13:22:25.977994 bus /gobi_0: Setting Powered False 13:22:27.075926 bus /gobi_0: Setting Powered False 13:22:28.193344 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:22:29.339947 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:29.351650 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:22:29.404836 tst iperf3.py: using LAC 28684 13:22:29.532752 tst iperf3.py: using RAC 124 13:22:29.662677 tst iperf3.py: using CellId 28684 13:22:29.788620 tst iperf3.py: using BVCI 28685 13:22:29.907468 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:29.918712 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:29.929724 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:29.940658 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:29.951568 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:29.962485 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:29.973617 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:29.984469 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:29.995614 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:22:30.110892 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:22:30.313367 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:22:30.614766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13000): Launched 13:22:30.881134 run iperf3-srv_10.42.42.10(pid=13001): Launched 13:22:31.022825 tst iperf3.py:8: start network... 13:22:31.228582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:31.704537 run create_hlr_db(pid=13002): Launched 13:22:31.860160 bus /gobi_6: Setting Powered False 13:22:32.920011 run create_hlr_db(pid=13002): Terminated: ok {rc=0} 13:22:33.355795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13004): Launched 13:22:33.677333 run osmo-hlr_10.42.42.2(pid=13005): Launched 13:22:33.799992 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:34.358305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13007): Launched 13:22:34.678977 run osmo-stp_10.42.42.5(pid=13008): Launched 13:22:34.802013 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:22:35.357833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13010): Launched 13:22:35.479788 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:22:35.750232 run patchelf(pid=13011): Launched 13:22:35.928202 run osmo-stp_10.42.42.5(pid=13008): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13008)] 13:22:36.065927 run osmo-stp_10.42.42.5(pid=13008): stdout: | (launched: 2022-12-10_13:22:34.620521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:36.203271 run osmo-stp_10.42.42.5(pid=13008): stderr: | [0;m[38;5;43m20221210132234812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132234812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132234812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132234813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132234813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132234813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132234813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:36.341087 run osmo-stp_10.42.42.5(pid=13008): stdout: | (launched: 2022-12-10_13:22:34.620521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:36.473120 run osmo-stp_10.42.42.5(pid=13008): stderr: | [0;m[38;5;43m20221210132234812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132234812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132234812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132234813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132234813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132234813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132234813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:36.629106 run patchelf(pid=13011): Terminating (SIGINT) 13:22:36.808892 run patchelf(pid=13011): Terminated: ok {rc=0} 13:22:36.938490 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13008): Process ended prematurely: osmo-stp_10.42.42.5(pid=13008) [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13008)] [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 13:22:36.948532 tst iperf3.py:8: Test FAILED (7.6 sec) 13:22:36.977251 run osmo-hlr_10.42.42.2(pid=13005): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13005)] 13:22:37.026819 run osmo-hlr_10.42.42.2(pid=13005): stdout: | (launched: 2022-12-10_13:22:33.619001) 13:22:37.077814 run osmo-hlr_10.42.42.2(pid=13005): stderr: | [0;m[1;31m20221210132233816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132233816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132233816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132233816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132233816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132233816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132233829 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132233837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132233837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132233837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:37.129494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13000): Terminating (SIGTERM) 13:22:37.170662 run iperf3-srv_10.42.42.10(pid=13001): Terminating (SIGTERM) 13:22:37.211844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13004): Terminating (SIGTERM) 13:22:37.253072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13007): Terminating (SIGTERM) 13:22:37.294187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13010): Terminating (SIGTERM) 13:22:37.335724 --- ParallelTerminationStrategy: PID 13000 died... 13:22:37.355438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13000): Terminated: ok {rc=0} 13:22:37.400894 --- ParallelTerminationStrategy: PID 13001 died... 13:22:37.420295 run iperf3-srv_10.42.42.10(pid=13001): Terminated {rc=256} 13:22:37.465867 --- ParallelTerminationStrategy: PID 13004 died... 13:22:37.485510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13004): Terminated: ok {rc=0} 13:22:37.530923 --- ParallelTerminationStrategy: PID 13007 died... 13:22:37.550081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13007): Terminated: ok {rc=0} 13:22:37.595665 --- ParallelTerminationStrategy: PID 13010 died... 13:22:37.615084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13010): Terminated: ok {rc=0} 13:22:37.701612 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:22:38.849614 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:38.860716 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:22:38.908743 tst iperf3m4.py: using LAC 28685 13:22:39.028538 tst iperf3m4.py: using RAC 125 13:22:39.149486 tst iperf3m4.py: using CellId 28685 13:22:39.277028 tst iperf3m4.py: using BVCI 28686 13:22:39.393917 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:39.405216 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:39.416195 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:39.427759 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:39.438835 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:39.449736 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:39.460702 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:39.471535 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:39.482764 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:22:39.601315 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:22:39.720254 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:22:39.841436 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:22:39.958378 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:22:40.163168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:22:40.465292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13014): Launched 13:22:40.726755 run iperf3-srv_10.42.42.10(pid=13015): Launched 13:22:40.839763 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:22:41.046945 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:22:41.370170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13016): Launched 13:22:41.648499 run iperf3-srv_10.42.42.10(pid=13017): Launched 13:22:41.768562 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:22:41.984689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:22:42.305689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13018): Launched 13:22:42.584503 run iperf3-srv_10.42.42.10(pid=13019): Launched 13:22:42.704895 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:22:42.921982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:22:43.245661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13020): Launched 13:22:43.526020 run iperf3-srv_10.42.42.10(pid=13021): Launched 13:22:43.645843 tst iperf3m4.py:8: start network... 13:22:43.862505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:44.360917 run create_hlr_db(pid=13022): Launched 13:22:44.491935 bus /gobi_6: Setting Powered False 13:22:45.554721 run create_hlr_db(pid=13022): Terminated: ok {rc=0} 13:22:45.998574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13024): Launched 13:22:46.323079 run osmo-hlr_10.42.42.2(pid=13025): Launched 13:22:46.611084 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:47.221992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13027): Launched 13:22:47.559710 run osmo-stp_10.42.42.5(pid=13028): Launched 13:22:47.681869 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:22:48.236354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13030): Launched 13:22:48.358662 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:22:48.630244 run patchelf(pid=13031): Launched 13:22:48.808171 run osmo-stp_10.42.42.5(pid=13028): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13028)] 13:22:48.943647 run osmo-stp_10.42.42.5(pid=13028): stdout: | (launched: 2022-12-10_13:22:47.501233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:49.081615 run osmo-stp_10.42.42.5(pid=13028): stderr: | [0;m[38;5;43m20221210132247693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132247693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132247693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132247693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132247696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132247696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132247696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:49.219328 run osmo-stp_10.42.42.5(pid=13028): stdout: | (launched: 2022-12-10_13:22:47.501233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:49.351229 run osmo-stp_10.42.42.5(pid=13028): stderr: | [0;m[38;5;43m20221210132247693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132247693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132247693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132247693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132247696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132247696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132247696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:49.507791 run patchelf(pid=13031): Terminating (SIGINT) 13:22:49.687983 run patchelf(pid=13031): Terminated: ok {rc=0} 13:22:49.817724 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13028): Process ended prematurely: osmo-stp_10.42.42.5(pid=13028) [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13028)] [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 13:22:49.827699 tst iperf3m4.py:8: Test FAILED (11.0 sec) 13:22:49.856239 run osmo-hlr_10.42.42.2(pid=13025): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13025)] 13:22:49.905749 run osmo-hlr_10.42.42.2(pid=13025): stdout: | (launched: 2022-12-10_13:22:46.257232) 13:22:49.956604 run osmo-hlr_10.42.42.2(pid=13025): stderr: | [0;m[1;31m20221210132246465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132246465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132246466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132246466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132246466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132246466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132246479 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132246492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132246492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132246492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:50.008150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13014): Terminating (SIGTERM) 13:22:50.049479 run iperf3-srv_10.42.42.10(pid=13015): Terminating (SIGTERM) 13:22:50.090957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13016): Terminating (SIGTERM) 13:22:50.132545 run iperf3-srv_10.42.42.10(pid=13017): Terminating (SIGTERM) 13:22:50.174020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13018): Terminating (SIGTERM) 13:22:50.215671 run iperf3-srv_10.42.42.10(pid=13019): Terminating (SIGTERM) 13:22:50.256937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13020): Terminating (SIGTERM) 13:22:50.298716 run iperf3-srv_10.42.42.10(pid=13021): Terminating (SIGTERM) 13:22:50.340099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13024): Terminating (SIGTERM) 13:22:50.381620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13027): Terminating (SIGTERM) 13:22:50.423071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13030): Terminating (SIGTERM) 13:22:50.465282 --- ParallelTerminationStrategy: PID 13014 died... 13:22:50.485280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13014): Terminated: ok {rc=0} 13:22:50.530991 --- ParallelTerminationStrategy: PID 13015 died... 13:22:50.550401 run iperf3-srv_10.42.42.10(pid=13015): Terminated {rc=256} 13:22:50.595988 --- ParallelTerminationStrategy: PID 13016 died... 13:22:50.615234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13016): Terminated: ok {rc=0} 13:22:50.660806 --- ParallelTerminationStrategy: PID 13017 died... 13:22:50.680130 run iperf3-srv_10.42.42.10(pid=13017): Terminated {rc=256} 13:22:50.725373 --- ParallelTerminationStrategy: PID 13018 died... 13:22:50.744584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13018): Terminated: ok {rc=0} 13:22:50.790090 --- ParallelTerminationStrategy: PID 13019 died... 13:22:50.809435 run iperf3-srv_10.42.42.10(pid=13019): Terminated {rc=256} 13:22:50.854908 --- ParallelTerminationStrategy: PID 13020 died... 13:22:50.874152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13020): Terminated: ok {rc=0} 13:22:50.919484 --- ParallelTerminationStrategy: PID 13021 died... 13:22:50.938876 run iperf3-srv_10.42.42.10(pid=13021): Terminated {rc=256} 13:22:50.984937 --- ParallelTerminationStrategy: PID 13024 died... 13:22:51.004538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13024): Terminated: ok {rc=0} 13:22:51.050376 --- ParallelTerminationStrategy: PID 13027 died... 13:22:51.069982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13027): Terminated: ok {rc=0} 13:22:51.116122 --- ParallelTerminationStrategy: PID 13030 died... 13:22:51.135782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13030): Terminated: ok {rc=0} 13:22:51.222691 bus /gobi_4: Setting Powered False 13:22:52.321810 bus /gobi_4: Setting Powered False 13:22:53.438218 bus /gobi_1: Setting Powered False 13:22:54.536509 bus /gobi_1: Setting Powered False 13:22:55.650718 bus /gobi_0: Setting Powered False 13:22:56.747396 bus /gobi_0: Setting Powered False 13:22:57.863581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 13:22:58.964564 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:58.976001 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:22:59.026171 tst ping.py: using LAC 28686 13:22:59.144136 tst ping.py: using RAC 126 13:22:59.261376 tst ping.py: using CellId 28686 13:22:59.377702 tst ping.py: using BVCI 28687 13:22:59.485450 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:59.496102 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:59.506641 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:59.517441 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:59.528139 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:59.539295 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:59.550222 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:22:59.560916 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:22:59.678762 tst ping.py:19: start network... 13:22:59.892654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:00.382702 run create_hlr_db(pid=13032): Launched 13:23:00.512017 bus /gobi_6: Setting Powered False 13:23:01.572001 run create_hlr_db(pid=13032): Terminated: ok {rc=0} 13:23:02.048072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13034): Launched 13:23:02.378121 run osmo-hlr_10.42.42.2(pid=13035): Launched 13:23:02.498852 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:03.044762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13037): Launched 13:23:03.359652 run osmo-stp_10.42.42.5(pid=13038): Launched 13:23:03.479721 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:23:04.025025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13040): Launched 13:23:04.145537 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:23:04.412211 run patchelf(pid=13041): Launched 13:23:04.588833 run osmo-stp_10.42.42.5(pid=13038): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13038)] 13:23:04.722807 run osmo-stp_10.42.42.5(pid=13038): stdout: | (launched: 2022-12-10_13:23:03.302201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:04.858014 run osmo-stp_10.42.42.5(pid=13038): stderr: | [0;m[38;5;43m20221210132303495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132303495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132303495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132303496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132303496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132303496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132303496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:04.993256 run osmo-stp_10.42.42.5(pid=13038): stdout: | (launched: 2022-12-10_13:23:03.302201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:05.123166 run osmo-stp_10.42.42.5(pid=13038): stderr: | [0;m[38;5;43m20221210132303495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132303495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132303495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132303496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132303496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132303496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132303496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:05.277724 run patchelf(pid=13041): Terminating (SIGINT) 13:23:05.455793 run patchelf(pid=13041): Terminated: ok {rc=0} 13:23:05.583815 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13038): Process ended prematurely: osmo-stp_10.42.42.5(pid=13038) [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13038)] [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 13:23:05.593192 tst ping.py:22: Test FAILED (6.6 sec) 13:23:05.620928 run osmo-hlr_10.42.42.2(pid=13035): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13035)] 13:23:05.672017 run osmo-hlr_10.42.42.2(pid=13035): stdout: | (launched: 2022-12-10_13:23:02.320321) 13:23:05.723224 run osmo-hlr_10.42.42.2(pid=13035): stderr: | [0;m[1;31m20221210132302519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132302519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132302519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132302519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132302519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132302519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132302532 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132302540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132302541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132302541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:05.774875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13034): Terminating (SIGTERM) 13:23:05.816206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13037): Terminating (SIGTERM) 13:23:05.858316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13040): Terminating (SIGTERM) 13:23:05.900303 --- ParallelTerminationStrategy: PID 13034 died... 13:23:05.920375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13034): Terminated: ok {rc=0} 13:23:05.967179 --- ParallelTerminationStrategy: PID 13037 died... 13:23:05.986809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13037): Terminated: ok {rc=0} 13:23:06.032706 --- ParallelTerminationStrategy: PID 13040 died... 13:23:06.052297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13040): Terminated: ok {rc=0} 13:23:06.139445 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:23:07.227607 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:23:07.240111 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:23:07.292630 tst ping_idle_ping.py: using LAC 28687 13:23:07.417437 tst ping_idle_ping.py: using RAC 127 13:23:07.544732 tst ping_idle_ping.py: using CellId 28687 13:23:07.668892 tst ping_idle_ping.py: using BVCI 28688 13:23:07.785203 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:23:07.796406 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:23:07.807490 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:23:07.818543 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:23:07.829456 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:23:07.840400 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:23:07.851553 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:23:07.862637 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:23:07.978078 tst ping_idle_ping.py:24: start network... 13:23:08.177213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:08.640007 run create_hlr_db(pid=13042): Launched 13:23:08.769320 bus /gobi_6: Setting Powered False 13:23:09.832118 run create_hlr_db(pid=13042): Terminated: ok {rc=0} 13:23:10.256541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13044): Launched 13:23:10.553201 run osmo-hlr_10.42.42.2(pid=13045): Launched 13:23:10.666328 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:11.183109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13047): Launched 13:23:11.480628 run osmo-stp_10.42.42.5(pid=13048): Launched 13:23:11.594227 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:23:12.106866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13050): Launched 13:23:12.220564 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:23:12.472716 run patchelf(pid=13051): Launched 13:23:12.638534 run osmo-stp_10.42.42.5(pid=13048): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13048)] 13:23:12.764783 run osmo-stp_10.42.42.5(pid=13048): stdout: | (launched: 2022-12-10_13:23:11.425964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:12.892782 run osmo-stp_10.42.42.5(pid=13048): stderr: | [0;m[38;5;43m20221210132311595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132311596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132311596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132311596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132311597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132311597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132311597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:13.020385 run osmo-stp_10.42.42.5(pid=13048): stdout: | (launched: 2022-12-10_13:23:11.425964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:13.142599 run osmo-stp_10.42.42.5(pid=13048): stderr: | [0;m[38;5;43m20221210132311595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132311596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132311596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132311596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132311597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132311597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132311597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:13.287970 run patchelf(pid=13051): Terminating (SIGINT) 13:23:13.456444 run patchelf(pid=13051): Terminated: ok {rc=0} 13:23:13.577093 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13048): Process ended prematurely: osmo-stp_10.42.42.5(pid=13048) [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13048)] [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 13:23:13.585875 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:23:13.612700 run osmo-hlr_10.42.42.2(pid=13045): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13045)] 13:23:13.659968 run osmo-hlr_10.42.42.2(pid=13045): stdout: | (launched: 2022-12-10_13:23:10.498602) 13:23:13.708883 run osmo-hlr_10.42.42.2(pid=13045): stderr: | [0;m[1;31m20221210132310673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132310673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132310673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132310673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132310673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132310673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132310685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132310694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132310694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132310695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:13.758395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13044): Terminating (SIGTERM) 13:23:13.798069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13047): Terminating (SIGTERM) 13:23:13.837722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13050): Terminating (SIGTERM) 13:23:13.877447 --- ParallelTerminationStrategy: PID 13044 died... 13:23:13.896502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13044): Terminated: ok {rc=0} 13:23:13.940774 --- ParallelTerminationStrategy: PID 13047 died... 13:23:13.959355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13047): Terminated: ok {rc=0} 13:23:14.003219 --- ParallelTerminationStrategy: PID 13050 died... 13:23:14.021850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13050): Terminated: ok {rc=0} 13:23:14.107301 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:23:15.401519 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:23:15.407382 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:23:15.440259 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:23:15.478218 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:23:15.566211 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:23:15.600209 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:23:15.638154 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:23:16.237323 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:23:16.306346 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:16.321433 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:23:16.402319 tst cs_paging_gprs_active.py: using LAC 28688 13:23:16.528699 tst cs_paging_gprs_active.py: using RAC 128 13:23:16.679276 tst cs_paging_gprs_active.py: using CellId 28688 13:23:16.852275 tst cs_paging_gprs_active.py: using BVCI 28689 13:23:17.030923 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:17.046016 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:17.065731 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:17.081669 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:17.097660 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:17.113528 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:17.129374 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:17.144284 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:17.158535 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:23:17.312613 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:23:17.467165 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:23:17.718626 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:23:18.115025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13129): Launched 13:23:18.453811 run iperf3-srv_10.42.42.10(pid=13165): Launched 13:23:18.604318 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:23:18.854068 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:23:19.243377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13261): Launched 13:23:19.588271 run iperf3-srv_10.42.42.10(pid=13311): Launched 13:23:19.765025 tst cs_paging_gprs_active.py:38: start network... 13:23:19.993318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:20.484586 run create_hlr_db(pid=13329): Launched 13:23:20.650390 bus /gobi_6: Setting Powered False 13:23:21.715711 run create_hlr_db(pid=13329): Terminated: ok {rc=0} 13:23:22.159124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13333): Launched 13:23:22.482280 run osmo-hlr_10.42.42.2(pid=13334): Launched 13:23:22.730317 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:23.409695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13336): Launched 13:23:23.749111 run osmo-stp_10.42.42.5(pid=13337): Launched 13:23:23.998357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:23:24.653943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13339): Launched 13:23:24.789867 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:23:25.084262 run patchelf(pid=13340): Launched 13:23:25.283402 run osmo-stp_10.42.42.5(pid=13337): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13337)] 13:23:25.425444 run osmo-stp_10.42.42.5(pid=13337): stdout: | (launched: 2022-12-10_13:23:23.684349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:25.568757 run osmo-stp_10.42.42.5(pid=13337): stderr: | [0;m[38;5;43m20221210132323982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132323982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132323983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132323983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132323983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132323983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132323984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:25.711538 run osmo-stp_10.42.42.5(pid=13337): stdout: | (launched: 2022-12-10_13:23:23.684349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:25.848925 run osmo-stp_10.42.42.5(pid=13337): stderr: | [0;m[38;5;43m20221210132323982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132323982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132323983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132323983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132323983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132323983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132323984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:26.011134 run patchelf(pid=13340): Terminating (SIGINT) 13:23:26.201588 run patchelf(pid=13340): Terminated: ok {rc=0} 13:23:26.336175 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13337): Process ended prematurely: osmo-stp_10.42.42.5(pid=13337) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13337)] [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:23:26.347877 tst cs_paging_gprs_active.py:38: Test FAILED (10.1 sec) 13:23:26.377778 run osmo-hlr_10.42.42.2(pid=13334): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13334)] 13:23:26.430001 run osmo-hlr_10.42.42.2(pid=13334): stdout: | (launched: 2022-12-10_13:23:22.416844) 13:23:26.483842 run osmo-hlr_10.42.42.2(pid=13334): stderr: | [0;m[1;31m20221210132322720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132322720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132322720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132322720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132322720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132322720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132322739 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132322747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132322747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132322747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:26.538331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13129): Terminating (SIGTERM) 13:23:26.581879 run iperf3-srv_10.42.42.10(pid=13165): Terminating (SIGTERM) 13:23:26.625959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13261): Terminating (SIGTERM) 13:23:26.669911 run iperf3-srv_10.42.42.10(pid=13311): Terminating (SIGTERM) 13:23:26.715940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13333): Terminating (SIGTERM) 13:23:26.760490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13336): Terminating (SIGTERM) 13:23:26.805339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13339): Terminating (SIGTERM) 13:23:26.850269 --- ParallelTerminationStrategy: PID 13129 died... 13:23:26.870552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13129): Terminated: ok {rc=0} 13:23:26.919297 --- ParallelTerminationStrategy: PID 13165 died... 13:23:26.940186 run iperf3-srv_10.42.42.10(pid=13165): Terminated {rc=256} 13:23:26.987258 --- ParallelTerminationStrategy: PID 13261 died... 13:23:27.007993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13261): Terminated: ok {rc=0} 13:23:27.055250 --- ParallelTerminationStrategy: PID 13311 died... 13:23:27.075652 run iperf3-srv_10.42.42.10(pid=13311): Terminated {rc=256} 13:23:27.123216 --- ParallelTerminationStrategy: PID 13333 died... 13:23:27.144654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13333): Terminated: ok {rc=0} 13:23:27.193825 --- ParallelTerminationStrategy: PID 13336 died... 13:23:27.214703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13336): Terminated: ok {rc=0} 13:23:27.262166 --- ParallelTerminationStrategy: PID 13339 died... 13:23:27.282828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13339): Terminated: ok {rc=0} 13:23:27.374221 bus /gobi_0: Setting Powered False 13:23:28.476319 bus /gobi_0: Setting Powered False 13:23:29.595316 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:23:30.745332 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:30.757619 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:23:30.841206 tst iperf3.py: using LAC 28689 13:23:30.982965 tst iperf3.py: using RAC 129 13:23:31.147598 tst iperf3.py: using CellId 28689 13:23:31.280676 tst iperf3.py: using BVCI 28690 13:23:31.443448 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:31.455307 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:31.466693 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:31.478345 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:31.489589 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:31.501080 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:31.512828 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:31.524440 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:31.536215 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:23:31.692358 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:23:31.931699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:23:32.263103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13341): Launched 13:23:32.561355 run iperf3-srv_10.42.42.10(pid=13342): Launched 13:23:32.699813 tst iperf3.py:8: start network... 13:23:32.921368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:33.513729 run create_hlr_db(pid=13343): Launched 13:23:33.658666 bus /gobi_6: Setting Powered False 13:23:34.720090 run create_hlr_db(pid=13343): Terminated: ok {rc=0} 13:23:35.163479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13345): Launched 13:23:35.494216 run osmo-hlr_10.42.42.2(pid=13346): Launched 13:23:35.738048 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:36.592230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13348): Launched 13:23:36.925920 run osmo-stp_10.42.42.5(pid=13349): Launched 13:23:37.164274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:23:37.869696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13351): Launched 13:23:37.996604 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:23:38.272676 run patchelf(pid=13352): Launched 13:23:38.451749 run osmo-stp_10.42.42.5(pid=13349): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13349)] 13:23:38.584052 run osmo-stp_10.42.42.5(pid=13349): stdout: | (launched: 2022-12-10_13:23:36.854603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:38.717189 run osmo-stp_10.42.42.5(pid=13349): stderr: | [0;m[38;5;43m20221210132337194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132337194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132337195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132337195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132337196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132337196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132337196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:38.850947 run osmo-stp_10.42.42.5(pid=13349): stdout: | (launched: 2022-12-10_13:23:36.854603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:38.978683 run osmo-stp_10.42.42.5(pid=13349): stderr: | [0;m[38;5;43m20221210132337194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132337194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132337195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132337195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132337196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132337196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132337196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:39.130004 run patchelf(pid=13352): Terminating (SIGINT) 13:23:39.305309 run patchelf(pid=13352): Terminated: ok {rc=0} 13:23:39.432360 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13349): Process ended prematurely: osmo-stp_10.42.42.5(pid=13349) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13349)] [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 13:23:39.442938 tst iperf3.py:8: Test FAILED (8.7 sec) 13:23:39.474234 run osmo-hlr_10.42.42.2(pid=13346): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13346)] 13:23:39.524701 run osmo-hlr_10.42.42.2(pid=13346): stdout: | (launched: 2022-12-10_13:23:35.431239) 13:23:39.577474 run osmo-hlr_10.42.42.2(pid=13346): stderr: | [0;m[1;31m20221210132335784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132335784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132335784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132335784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132335784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132335784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132335801 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132335817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132335817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132335818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:39.630509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13341): Terminating (SIGTERM) 13:23:39.673771 run iperf3-srv_10.42.42.10(pid=13342): Terminating (SIGTERM) 13:23:39.719437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13345): Terminating (SIGTERM) 13:23:39.763904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13348): Terminating (SIGTERM) 13:23:39.808408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13351): Terminating (SIGTERM) 13:23:39.853711 --- ParallelTerminationStrategy: PID 13341 died... 13:23:39.873854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13341): Terminated: ok {rc=0} 13:23:39.923085 --- ParallelTerminationStrategy: PID 13342 died... 13:23:39.943843 run iperf3-srv_10.42.42.10(pid=13342): Terminated {rc=256} 13:23:39.992727 --- ParallelTerminationStrategy: PID 13345 died... 13:23:40.012793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13345): Terminated: ok {rc=0} 13:23:40.060269 --- ParallelTerminationStrategy: PID 13348 died... 13:23:40.080098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13348): Terminated: ok {rc=0} 13:23:40.128248 --- ParallelTerminationStrategy: PID 13351 died... 13:23:40.149093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13351): Terminated: ok {rc=0} 13:23:40.239189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:23:41.383449 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:41.394942 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:23:41.462460 tst iperf3m4.py: using LAC 28690 13:23:41.580023 tst iperf3m4.py: using RAC 130 13:23:41.699978 tst iperf3m4.py: using CellId 28690 13:23:41.823762 tst iperf3m4.py: using BVCI 28691 13:23:41.938188 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:41.949442 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:41.960294 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:41.971385 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:41.982530 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:41.993727 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:42.004664 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:42.015524 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:23:42.026709 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:23:42.145048 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:23:42.264516 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:23:42.379125 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:23:42.493370 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:23:42.691135 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:23:42.987119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13353): Launched 13:23:43.243719 run iperf3-srv_10.42.42.10(pid=13354): Launched 13:23:43.354418 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:23:43.553527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:23:43.849709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13355): Launched 13:23:44.106174 run iperf3-srv_10.42.42.10(pid=13356): Launched 13:23:44.216785 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:23:44.414911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:23:44.711189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13357): Launched 13:23:44.967782 run iperf3-srv_10.42.42.10(pid=13358): Launched 13:23:45.078103 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:23:45.275026 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:23:45.571892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13359): Launched 13:23:45.831550 run iperf3-srv_10.42.42.10(pid=13360): Launched 13:23:45.979408 tst iperf3m4.py:8: start network... 13:23:46.187889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:46.668938 run create_hlr_db(pid=13361): Launched 13:23:46.816173 bus /gobi_6: Setting Powered False 13:23:47.875613 run create_hlr_db(pid=13361): Terminated: ok {rc=0} 13:23:48.320462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13363): Launched 13:23:48.635212 run osmo-hlr_10.42.42.2(pid=13364): Launched 13:23:48.755436 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:49.301855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13366): Launched 13:23:49.616920 run osmo-stp_10.42.42.5(pid=13367): Launched 13:23:49.736873 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:23:50.281580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13369): Launched 13:23:50.402102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:23:50.670281 run patchelf(pid=13370): Launched 13:23:50.845661 run osmo-stp_10.42.42.5(pid=13367): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13367)] 13:23:50.979178 run osmo-stp_10.42.42.5(pid=13367): stdout: | (launched: 2022-12-10_13:23:49.559097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:51.114708 run osmo-stp_10.42.42.5(pid=13367): stderr: | [0;m[38;5;43m20221210132349751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132349751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132349752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132349752 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132349754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132349755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132349755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:51.250152 run osmo-stp_10.42.42.5(pid=13367): stdout: | (launched: 2022-12-10_13:23:49.559097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:51.380262 run osmo-stp_10.42.42.5(pid=13367): stderr: | [0;m[38;5;43m20221210132349751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132349751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132349752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132349752 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132349754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132349755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132349755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:51.534809 run patchelf(pid=13370): Terminating (SIGINT) 13:23:51.712711 run patchelf(pid=13370): Terminated: ok {rc=0} 13:23:51.840796 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13367): Process ended prematurely: osmo-stp_10.42.42.5(pid=13367) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13367)] [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:23:51.851007 tst iperf3m4.py:8: Test FAILED (10.5 sec) 13:23:51.879288 run osmo-hlr_10.42.42.2(pid=13364): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13364)] 13:23:51.929361 run osmo-hlr_10.42.42.2(pid=13364): stdout: | (launched: 2022-12-10_13:23:48.578137) 13:23:51.980485 run osmo-hlr_10.42.42.2(pid=13364): stderr: | [0;m[1;31m20221210132348779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132348779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132348779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132348779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132348779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132348779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132348791 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132348800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132348800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132348800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:52.032443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13353): Terminating (SIGTERM) 13:23:52.073991 run iperf3-srv_10.42.42.10(pid=13354): Terminating (SIGTERM) 13:23:52.115266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13355): Terminating (SIGTERM) 13:23:52.156618 run iperf3-srv_10.42.42.10(pid=13356): Terminating (SIGTERM) 13:23:52.197904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13357): Terminating (SIGTERM) 13:23:52.239260 run iperf3-srv_10.42.42.10(pid=13358): Terminating (SIGTERM) 13:23:52.280501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13359): Terminating (SIGTERM) 13:23:52.322045 run iperf3-srv_10.42.42.10(pid=13360): Terminating (SIGTERM) 13:23:52.363291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13363): Terminating (SIGTERM) 13:23:52.404798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13366): Terminating (SIGTERM) 13:23:52.446391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13369): Terminating (SIGTERM) 13:23:52.488371 --- ParallelTerminationStrategy: PID 13353 died... 13:23:52.508418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13353): Terminated: ok {rc=0} 13:23:52.554588 --- ParallelTerminationStrategy: PID 13354 died... 13:23:52.574004 run iperf3-srv_10.42.42.10(pid=13354): Terminated {rc=256} 13:23:52.619435 --- ParallelTerminationStrategy: PID 13355 died... 13:23:52.638691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13355): Terminated: ok {rc=0} 13:23:52.684189 --- ParallelTerminationStrategy: PID 13356 died... 13:23:52.703451 run iperf3-srv_10.42.42.10(pid=13356): Terminated {rc=256} 13:23:52.748538 --- ParallelTerminationStrategy: PID 13357 died... 13:23:52.767856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13357): Terminated: ok {rc=0} 13:23:52.813416 --- ParallelTerminationStrategy: PID 13358 died... 13:23:52.832632 run iperf3-srv_10.42.42.10(pid=13358): Terminated {rc=256} 13:23:52.877867 --- ParallelTerminationStrategy: PID 13359 died... 13:23:52.897200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13359): Terminated: ok {rc=0} 13:23:52.942661 --- ParallelTerminationStrategy: PID 13360 died... 13:23:52.962024 run iperf3-srv_10.42.42.10(pid=13360): Terminated {rc=256} 13:23:53.007581 --- ParallelTerminationStrategy: PID 13363 died... 13:23:53.026973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13363): Terminated: ok {rc=0} 13:23:53.072345 --- ParallelTerminationStrategy: PID 13366 died... 13:23:53.091756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13366): Terminated: ok {rc=0} 13:23:53.137285 --- ParallelTerminationStrategy: PID 13369 died... 13:23:53.156650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13369): Terminated: ok {rc=0} 13:23:53.243071 bus /gobi_4: Setting Powered False 13:23:54.342117 bus /gobi_4: Setting Powered False 13:23:55.458225 bus /gobi_1: Setting Powered False 13:23:56.556064 bus /gobi_1: Setting Powered False 13:23:57.670734 bus /gobi_0: Setting Powered False 13:23:58.768519 bus /gobi_0: Setting Powered False 13:23:59.883966 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:24:00.993184 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:01.005441 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:24:01.080820 tst ping.py: using LAC 28691 13:24:01.205986 tst ping.py: using RAC 131 13:24:01.368254 tst ping.py: using CellId 28691 13:24:01.484500 tst ping.py: using BVCI 28692 13:24:01.602936 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:01.617578 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:01.633077 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:01.648056 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:01.663584 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:01.679305 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:01.694482 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:01.709349 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:24:01.831352 tst ping.py:19: start network... 13:24:02.036473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:02.500014 run create_hlr_db(pid=13371): Launched 13:24:02.612712 bus /gobi_6: Setting Powered False 13:24:03.671735 run create_hlr_db(pid=13371): Terminated: ok {rc=0} 13:24:04.097105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13373): Launched 13:24:04.405508 run osmo-hlr_10.42.42.2(pid=13374): Launched 13:24:04.524824 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:05.065046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13376): Launched 13:24:05.375678 run osmo-stp_10.42.42.5(pid=13377): Launched 13:24:05.493476 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:06.029684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13379): Launched 13:24:06.148195 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:06.411630 run patchelf(pid=13380): Launched 13:24:06.585281 run osmo-stp_10.42.42.5(pid=13377): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13377)] 13:24:06.717363 run osmo-stp_10.42.42.5(pid=13377): stdout: | (launched: 2022-12-10_13:24:05.318941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:06.851243 run osmo-stp_10.42.42.5(pid=13377): stderr: | [0;m[38;5;43m20221210132405510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132405511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132405511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132405511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132405512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132405512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132405512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:06.984635 run osmo-stp_10.42.42.5(pid=13377): stdout: | (launched: 2022-12-10_13:24:05.318941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:07.113837 run osmo-stp_10.42.42.5(pid=13377): stderr: | [0;m[38;5;43m20221210132405510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132405511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132405511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132405511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132405512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132405512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132405512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:07.265772 run patchelf(pid=13380): Terminating (SIGINT) 13:24:07.440845 run patchelf(pid=13380): Terminated: ok {rc=0} 13:24:07.567572 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13377): Process ended prematurely: osmo-stp_10.42.42.5(pid=13377) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13377)] [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 13:24:07.576860 tst ping.py:22: Test FAILED (6.6 sec) 13:24:07.604389 run osmo-hlr_10.42.42.2(pid=13374): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13374)] 13:24:07.654094 run osmo-hlr_10.42.42.2(pid=13374): stdout: | (launched: 2022-12-10_13:24:04.349284) 13:24:07.705885 run osmo-hlr_10.42.42.2(pid=13374): stderr: | [0;m[1;31m20221210132404544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132404544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132404544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132404544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132404544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132404545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132404558 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132404566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132404566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132404566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:07.757736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13373): Terminating (SIGTERM) 13:24:07.799051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13376): Terminating (SIGTERM) 13:24:07.840409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13379): Terminating (SIGTERM) 13:24:07.882104 --- ParallelTerminationStrategy: PID 13373 died... 13:24:07.901762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13373): Terminated: ok {rc=0} 13:24:07.947403 --- ParallelTerminationStrategy: PID 13376 died... 13:24:07.966702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13376): Terminated: ok {rc=0} 13:24:08.012016 --- ParallelTerminationStrategy: PID 13379 died... 13:24:08.031272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13379): Terminated: ok {rc=0} 13:24:08.117636 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:24:09.204576 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:09.216452 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:24:09.288559 tst ping_idle_ping.py: using LAC 28692 13:24:09.404906 tst ping_idle_ping.py: using RAC 132 13:24:09.521133 tst ping_idle_ping.py: using CellId 28692 13:24:09.641934 tst ping_idle_ping.py: using BVCI 28693 13:24:09.751841 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:09.762573 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:09.773092 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:09.784460 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:09.795716 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:09.807067 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:09.818445 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:24:09.829666 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:24:09.944054 tst ping_idle_ping.py:24: start network... 13:24:10.139915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:10.593296 run create_hlr_db(pid=13382): Launched 13:24:10.704425 bus /gobi_6: Setting Powered False 13:24:11.764016 run create_hlr_db(pid=13382): Terminated: ok {rc=0} 13:24:12.172463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13384): Launched 13:24:12.464705 run osmo-hlr_10.42.42.2(pid=13385): Launched 13:24:12.576862 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:13.095632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13387): Launched 13:24:13.389328 run osmo-stp_10.42.42.5(pid=13388): Launched 13:24:13.501766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:14.008270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13390): Launched 13:24:14.120437 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:14.368529 run patchelf(pid=13391): Launched 13:24:14.531627 run osmo-stp_10.42.42.5(pid=13388): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13388)] 13:24:14.656436 run osmo-stp_10.42.42.5(pid=13388): stdout: | (launched: 2022-12-10_13:24:13.335693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:14.782333 run osmo-stp_10.42.42.5(pid=13388): stderr: | [0;m[38;5;43m20221210132413506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132413507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132413507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132413507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132413508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132413508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132413508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:14.908517 run osmo-stp_10.42.42.5(pid=13388): stdout: | (launched: 2022-12-10_13:24:13.335693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:15.029348 run osmo-stp_10.42.42.5(pid=13388): stderr: | [0;m[38;5;43m20221210132413506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132413507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132413507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132413507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132413508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132413508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132413508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:15.172810 run patchelf(pid=13391): Terminating (SIGINT) 13:24:15.339131 run patchelf(pid=13391): Terminated: ok {rc=0} 13:24:15.458805 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13388): Process ended prematurely: osmo-stp_10.42.42.5(pid=13388) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13388)] [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:24:15.467567 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 13:24:15.494242 run osmo-hlr_10.42.42.2(pid=13385): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13385)] 13:24:15.541595 run osmo-hlr_10.42.42.2(pid=13385): stdout: | (launched: 2022-12-10_13:24:12.411313) 13:24:15.590386 run osmo-hlr_10.42.42.2(pid=13385): stderr: | [0;m[1;31m20221210132412589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132412589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132412589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132412589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132412589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132412589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132412602 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132412610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132412610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132412610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:15.639641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13384): Terminating (SIGTERM) 13:24:15.679072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13387): Terminating (SIGTERM) 13:24:15.718075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13390): Terminating (SIGTERM) 13:24:15.757898 --- ParallelTerminationStrategy: PID 13384 died... 13:24:15.776498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13384): Terminated: ok {rc=0} 13:24:15.820388 --- ParallelTerminationStrategy: PID 13387 died... 13:24:15.839018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13387): Terminated: ok {rc=0} 13:24:15.894903 --- ParallelTerminationStrategy: PID 13390 died... 13:24:15.914075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13390): Terminated: ok {rc=0} 13:24:15.999566 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:24:17.309995 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:24:17.316728 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:24:17.350327 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:24:17.388203 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:24:17.473376 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:24:17.507390 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:24:17.547088 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:24:18.135664 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:24:18.185376 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:18.196094 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:24:18.262546 tst cs_paging_gprs_active.py: using LAC 28693 13:24:18.378708 tst cs_paging_gprs_active.py: using RAC 133 13:24:18.494211 tst cs_paging_gprs_active.py: using CellId 28693 13:24:18.612770 tst cs_paging_gprs_active.py: using BVCI 28694 13:24:18.721511 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:18.732081 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:18.742612 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:18.753487 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:18.764086 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:18.774850 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:18.785688 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:18.796350 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:18.807196 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:24:18.925365 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:24:19.048531 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:24:19.263723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:19.583576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13395): Launched 13:24:19.861137 run iperf3-srv_10.42.42.10(pid=13396): Launched 13:24:19.980552 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:24:20.194961 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:20.515294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13397): Launched 13:24:20.792484 run iperf3-srv_10.42.42.10(pid=13398): Launched 13:24:20.911435 tst cs_paging_gprs_active.py:38: start network... 13:24:21.124900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:21.617533 run create_hlr_db(pid=13399): Launched 13:24:21.746999 bus /gobi_6: Setting Powered False 13:24:22.810011 run create_hlr_db(pid=13399): Terminated: ok {rc=0} 13:24:23.235062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13401): Launched 13:24:23.533079 run osmo-hlr_10.42.42.2(pid=13402): Launched 13:24:23.647859 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:24.179216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13404): Launched 13:24:24.477512 run osmo-stp_10.42.42.5(pid=13405): Launched 13:24:24.593240 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:25.109246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13407): Launched 13:24:25.231882 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:25.501846 run patchelf(pid=13408): Launched 13:24:25.667876 run osmo-stp_10.42.42.5(pid=13405): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13405)] 13:24:25.794476 run osmo-stp_10.42.42.5(pid=13405): stdout: | (launched: 2022-12-10_13:24:24.422543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:25.922672 run osmo-stp_10.42.42.5(pid=13405): stderr: | [0;m[38;5;43m20221210132424592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132424592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132424592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132424593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132424593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132424593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132424593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:26.050737 run osmo-stp_10.42.42.5(pid=13405): stdout: | (launched: 2022-12-10_13:24:24.422543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:26.173243 run osmo-stp_10.42.42.5(pid=13405): stderr: | [0;m[38;5;43m20221210132424592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132424592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132424592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132424593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132424593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132424593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132424593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:26.318414 run patchelf(pid=13408): Terminating (SIGINT) 13:24:26.486571 run patchelf(pid=13408): Terminated: ok {rc=0} 13:24:26.608586 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13405): Process ended prematurely: osmo-stp_10.42.42.5(pid=13405) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13405)] [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:24:26.618122 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:24:26.645368 run osmo-hlr_10.42.42.2(pid=13402): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13402)] 13:24:26.692427 run osmo-hlr_10.42.42.2(pid=13402): stdout: | (launched: 2022-12-10_13:24:23.478850) 13:24:26.741349 run osmo-hlr_10.42.42.2(pid=13402): stderr: | [0;m[1;31m20221210132423654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132423655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132423655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132423655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132423655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132423655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132423668 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132423678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132423678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132423678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:26.790993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13395): Terminating (SIGTERM) 13:24:26.830252 run iperf3-srv_10.42.42.10(pid=13396): Terminating (SIGTERM) 13:24:26.869413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13397): Terminating (SIGTERM) 13:24:26.908627 run iperf3-srv_10.42.42.10(pid=13398): Terminating (SIGTERM) 13:24:26.947497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13401): Terminating (SIGTERM) 13:24:26.986574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13404): Terminating (SIGTERM) 13:24:27.025849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13407): Terminating (SIGTERM) 13:24:27.065117 --- ParallelTerminationStrategy: PID 13395 died... 13:24:27.083878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13395): Terminated: ok {rc=0} 13:24:27.127813 --- ParallelTerminationStrategy: PID 13396 died... 13:24:27.146005 run iperf3-srv_10.42.42.10(pid=13396): Terminated {rc=256} 13:24:27.189654 --- ParallelTerminationStrategy: PID 13397 died... 13:24:27.207844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13397): Terminated: ok {rc=0} 13:24:27.252050 --- ParallelTerminationStrategy: PID 13398 died... 13:24:27.270386 run iperf3-srv_10.42.42.10(pid=13398): Terminated {rc=256} 13:24:27.313962 --- ParallelTerminationStrategy: PID 13401 died... 13:24:27.332199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13401): Terminated: ok {rc=0} 13:24:27.376079 --- ParallelTerminationStrategy: PID 13404 died... 13:24:27.394388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13404): Terminated: ok {rc=0} 13:24:27.438026 --- ParallelTerminationStrategy: PID 13407 died... 13:24:27.456349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13407): Terminated: ok {rc=0} 13:24:27.540167 bus /gobi_0: Setting Powered False 13:24:28.636499 bus /gobi_0: Setting Powered False 13:24:29.752668 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:24:30.911976 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:30.926559 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:24:30.998882 tst iperf3.py: using LAC 28694 13:24:31.130798 tst iperf3.py: using RAC 134 13:24:31.253296 tst iperf3.py: using CellId 28694 13:24:31.375331 tst iperf3.py: using BVCI 28695 13:24:31.490825 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:31.502906 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:31.514528 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:31.526858 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:31.539281 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:31.552887 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:31.564567 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:31.576514 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:31.588900 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:24:31.709239 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:24:31.966803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:32.288348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13409): Launched 13:24:32.563176 run iperf3-srv_10.42.42.10(pid=13410): Launched 13:24:32.681785 tst iperf3.py:8: start network... 13:24:32.894583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:33.383182 run create_hlr_db(pid=13411): Launched 13:24:33.512048 bus /gobi_6: Setting Powered False 13:24:34.575109 run create_hlr_db(pid=13411): Terminated: ok {rc=0} 13:24:34.996843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13413): Launched 13:24:35.293166 run osmo-hlr_10.42.42.2(pid=13414): Launched 13:24:35.406513 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:35.931333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13417): Launched 13:24:36.228836 run osmo-stp_10.42.42.5(pid=13418): Launched 13:24:36.342450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:36.855051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13420): Launched 13:24:36.968630 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:37.219488 run patchelf(pid=13421): Launched 13:24:37.384708 run osmo-stp_10.42.42.5(pid=13418): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13418)] 13:24:37.510437 run osmo-stp_10.42.42.5(pid=13418): stdout: | (launched: 2022-12-10_13:24:36.173408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:37.637952 run osmo-stp_10.42.42.5(pid=13418): stderr: | [0;m[38;5;43m20221210132436342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132436342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132436342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132436342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132436345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132436345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132436345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:37.765136 run osmo-stp_10.42.42.5(pid=13418): stdout: | (launched: 2022-12-10_13:24:36.173408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:37.886914 run osmo-stp_10.42.42.5(pid=13418): stderr: | [0;m[38;5;43m20221210132436342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132436342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132436342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132436342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132436345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132436345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132436345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:38.032028 run patchelf(pid=13421): Terminating (SIGINT) 13:24:38.199568 run patchelf(pid=13421): Terminated: ok {rc=0} 13:24:38.320254 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13418): Process ended prematurely: osmo-stp_10.42.42.5(pid=13418) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13418)] [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 13:24:38.329670 tst iperf3.py:8: Test FAILED (7.5 sec) 13:24:38.356345 run osmo-hlr_10.42.42.2(pid=13414): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13414)] 13:24:38.403707 run osmo-hlr_10.42.42.2(pid=13414): stdout: | (launched: 2022-12-10_13:24:35.239207) 13:24:38.452295 run osmo-hlr_10.42.42.2(pid=13414): stderr: | [0;m[1;31m20221210132435414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132435414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132435414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132435414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132435414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132435414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132435429 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132435437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132435437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132435437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:38.501762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13409): Terminating (SIGTERM) 13:24:38.541197 run iperf3-srv_10.42.42.10(pid=13410): Terminating (SIGTERM) 13:24:38.581126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13413): Terminating (SIGTERM) 13:24:38.620495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13417): Terminating (SIGTERM) 13:24:38.660422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13420): Terminating (SIGTERM) 13:24:38.700271 --- ParallelTerminationStrategy: PID 13409 died... 13:24:38.719009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13409): Terminated: ok {rc=0} 13:24:38.762956 --- ParallelTerminationStrategy: PID 13410 died... 13:24:38.781335 run iperf3-srv_10.42.42.10(pid=13410): Terminated {rc=256} 13:24:38.824710 --- ParallelTerminationStrategy: PID 13413 died... 13:24:38.843056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13413): Terminated: ok {rc=0} 13:24:38.886683 --- ParallelTerminationStrategy: PID 13417 died... 13:24:38.905111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13417): Terminated: ok {rc=0} 13:24:38.948542 --- ParallelTerminationStrategy: PID 13420 died... 13:24:38.967020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13420): Terminated: ok {rc=0} 13:24:39.051078 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:24:40.198235 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:40.210477 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:24:40.282515 tst iperf3m4.py: using LAC 28695 13:24:40.408639 tst iperf3m4.py: using RAC 135 13:24:40.533702 tst iperf3m4.py: using CellId 28695 13:24:40.659277 tst iperf3m4.py: using BVCI 28696 13:24:40.776352 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:40.787638 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:40.798661 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:40.809791 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:40.820645 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:40.831670 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:40.842788 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:40.853703 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:40.864894 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:24:40.979913 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:24:41.100872 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:24:41.215280 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:24:41.336811 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:24:41.551422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:41.869098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13422): Launched 13:24:42.145634 run iperf3-srv_10.42.42.10(pid=13423): Launched 13:24:42.264631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:24:42.478357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:42.797383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13424): Launched 13:24:43.073349 run iperf3-srv_10.42.42.10(pid=13425): Launched 13:24:43.191682 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:24:43.404356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:43.722458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13426): Launched 13:24:43.997259 run iperf3-srv_10.42.42.10(pid=13427): Launched 13:24:44.115842 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:24:44.328588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:44.647117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13428): Launched 13:24:44.921537 run iperf3-srv_10.42.42.10(pid=13429): Launched 13:24:45.040325 tst iperf3m4.py:8: start network... 13:24:45.254284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:45.748866 run create_hlr_db(pid=13430): Launched 13:24:45.891470 bus /gobi_6: Setting Powered False 13:24:46.952398 run create_hlr_db(pid=13430): Terminated: ok {rc=0} 13:24:47.385448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13432): Launched 13:24:47.685296 run osmo-hlr_10.42.42.2(pid=13433): Launched 13:24:47.799325 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:48.318292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13435): Launched 13:24:48.615846 run osmo-stp_10.42.42.5(pid=13436): Launched 13:24:48.729222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:49.244162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13438): Launched 13:24:49.358016 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:49.609855 run patchelf(pid=13439): Launched 13:24:49.775039 run osmo-stp_10.42.42.5(pid=13436): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13436)] 13:24:49.901071 run osmo-stp_10.42.42.5(pid=13436): stdout: | (launched: 2022-12-10_13:24:48.561556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:50.029255 run osmo-stp_10.42.42.5(pid=13436): stderr: | [0;m[38;5;43m20221210132448733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132448733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132448734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132448734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132448734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132448734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132448735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:50.157341 run osmo-stp_10.42.42.5(pid=13436): stdout: | (launched: 2022-12-10_13:24:48.561556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:50.279678 run osmo-stp_10.42.42.5(pid=13436): stderr: | [0;m[38;5;43m20221210132448733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132448733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132448734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132448734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132448734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132448734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132448735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:50.424097 run patchelf(pid=13439): Terminating (SIGINT) 13:24:50.591430 run patchelf(pid=13439): Terminated: ok {rc=0} 13:24:50.711896 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13436): Process ended prematurely: osmo-stp_10.42.42.5(pid=13436) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13436)] [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:24:50.721375 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:24:50.748838 run osmo-hlr_10.42.42.2(pid=13433): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13433)] 13:24:50.796701 run osmo-hlr_10.42.42.2(pid=13433): stdout: | (launched: 2022-12-10_13:24:47.630404) 13:24:50.846050 run osmo-hlr_10.42.42.2(pid=13433): stderr: | [0;m[1;31m20221210132447804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132447804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132447804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132447804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132447804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132447804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132447817 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132447826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132447826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132447826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:50.895608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13422): Terminating (SIGTERM) 13:24:50.935472 run iperf3-srv_10.42.42.10(pid=13423): Terminating (SIGTERM) 13:24:50.974883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13424): Terminating (SIGTERM) 13:24:51.015389 run iperf3-srv_10.42.42.10(pid=13425): Terminating (SIGTERM) 13:24:51.055109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13426): Terminating (SIGTERM) 13:24:51.095273 run iperf3-srv_10.42.42.10(pid=13427): Terminating (SIGTERM) 13:24:51.135481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13428): Terminating (SIGTERM) 13:24:51.175111 run iperf3-srv_10.42.42.10(pid=13429): Terminating (SIGTERM) 13:24:51.214462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13432): Terminating (SIGTERM) 13:24:51.254035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13435): Terminating (SIGTERM) 13:24:51.293419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13438): Terminating (SIGTERM) 13:24:51.333180 --- ParallelTerminationStrategy: PID 13422 died... 13:24:51.351818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13422): Terminated: ok {rc=0} 13:24:51.395731 --- ParallelTerminationStrategy: PID 13423 died... 13:24:51.413963 run iperf3-srv_10.42.42.10(pid=13423): Terminated {rc=256} 13:24:51.457253 --- ParallelTerminationStrategy: PID 13424 died... 13:24:51.475447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13424): Terminated: ok {rc=0} 13:24:51.518900 --- ParallelTerminationStrategy: PID 13425 died... 13:24:51.537149 run iperf3-srv_10.42.42.10(pid=13425): Terminated {rc=256} 13:24:51.581215 --- ParallelTerminationStrategy: PID 13426 died... 13:24:51.599330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13426): Terminated: ok {rc=0} 13:24:51.642887 --- ParallelTerminationStrategy: PID 13427 died... 13:24:51.661014 run iperf3-srv_10.42.42.10(pid=13427): Terminated {rc=256} 13:24:51.704269 --- ParallelTerminationStrategy: PID 13428 died... 13:24:51.722503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13428): Terminated: ok {rc=0} 13:24:51.765969 --- ParallelTerminationStrategy: PID 13429 died... 13:24:51.784123 run iperf3-srv_10.42.42.10(pid=13429): Terminated {rc=256} 13:24:51.827412 --- ParallelTerminationStrategy: PID 13432 died... 13:24:51.845692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13432): Terminated: ok {rc=0} 13:24:51.889074 --- ParallelTerminationStrategy: PID 13435 died... 13:24:51.907259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13435): Terminated: ok {rc=0} 13:24:51.950686 --- ParallelTerminationStrategy: PID 13438 died... 13:24:51.969010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13438): Terminated: ok {rc=0} 13:24:52.053411 bus /gobi_4: Setting Powered False 13:24:53.153220 bus /gobi_4: Setting Powered False 13:24:54.267433 bus /gobi_1: Setting Powered False 13:24:55.364689 bus /gobi_1: Setting Powered False 13:24:56.478574 bus /gobi_0: Setting Powered False 13:24:57.576398 bus /gobi_0: Setting Powered False 13:24:58.690803 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:24:59.793342 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:24:59.805298 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:24:59.876007 tst ping.py: using LAC 28696 13:25:00.000095 tst ping.py: using RAC 136 13:25:00.121307 tst ping.py: using CellId 28696 13:25:00.244903 tst ping.py: using BVCI 28697 13:25:00.357708 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:00.368826 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:00.379796 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:00.390880 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:00.401851 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:00.412818 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:00.423874 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:00.434909 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:25:00.552761 tst ping.py:19: start network... 13:25:00.760029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:01.277176 run create_hlr_db(pid=13441): Launched 13:25:01.431520 bus /gobi_6: Setting Powered False 13:25:02.494249 run create_hlr_db(pid=13441): Terminated: ok {rc=0} 13:25:02.921673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13446): Launched 13:25:03.213396 run osmo-hlr_10.42.42.2(pid=13447): Launched 13:25:03.325242 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:03.829499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13449): Launched 13:25:04.121708 run osmo-stp_10.42.42.5(pid=13450): Launched 13:25:04.233021 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:04.737653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13452): Launched 13:25:04.849673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:05.097506 run patchelf(pid=13453): Launched 13:25:05.260360 run osmo-stp_10.42.42.5(pid=13450): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13450)] 13:25:05.384931 run osmo-stp_10.42.42.5(pid=13450): stdout: | (launched: 2022-12-10_13:25:04.068228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:05.510834 run osmo-stp_10.42.42.5(pid=13450): stderr: | [0;m[38;5;43m20221210132504237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132504237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132504237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132504237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132504240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132504240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132504240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:05.636862 run osmo-stp_10.42.42.5(pid=13450): stdout: | (launched: 2022-12-10_13:25:04.068228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:05.757765 run osmo-stp_10.42.42.5(pid=13450): stderr: | [0;m[38;5;43m20221210132504237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132504237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132504237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132504237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132504240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132504240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132504240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:05.900917 run patchelf(pid=13453): Terminating (SIGINT) 13:25:06.066205 run patchelf(pid=13453): Terminated: ok {rc=0} 13:25:06.185427 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13450): Process ended prematurely: osmo-stp_10.42.42.5(pid=13450) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13450)] [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 13:25:06.194143 tst ping.py:22: Test FAILED (6.4 sec) 13:25:06.220753 run osmo-hlr_10.42.42.2(pid=13447): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13447)] 13:25:06.267989 run osmo-hlr_10.42.42.2(pid=13447): stdout: | (launched: 2022-12-10_13:25:03.159798) 13:25:06.316764 run osmo-hlr_10.42.42.2(pid=13447): stderr: | [0;m[1;31m20221210132503333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132503333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132503333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132503333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132503333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132503333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132503346 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132503355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132503355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132503355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:06.365930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13446): Terminating (SIGTERM) 13:25:06.405482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13449): Terminating (SIGTERM) 13:25:06.444915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13452): Terminating (SIGTERM) 13:25:06.484590 --- ParallelTerminationStrategy: PID 13446 died... 13:25:06.503565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13446): Terminated: ok {rc=0} 13:25:06.547733 --- ParallelTerminationStrategy: PID 13449 died... 13:25:06.566366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13449): Terminated: ok {rc=0} 13:25:06.610070 --- ParallelTerminationStrategy: PID 13452 died... 13:25:06.628308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13452): Terminated: ok {rc=0} 13:25:06.713672 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:25:07.802143 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:07.814036 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:25:07.885742 tst ping_idle_ping.py: using LAC 28697 13:25:08.011054 tst ping_idle_ping.py: using RAC 137 13:25:08.135740 tst ping_idle_ping.py: using CellId 28697 13:25:08.258839 tst ping_idle_ping.py: using BVCI 28698 13:25:08.373806 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:08.384928 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:08.395974 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:08.407111 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:08.418011 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:08.429016 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:08.440093 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:25:08.451196 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:25:08.568307 tst ping_idle_ping.py:24: start network... 13:25:08.778598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:09.261948 run create_hlr_db(pid=13454): Launched 13:25:09.388713 bus /gobi_6: Setting Powered False 13:25:10.451051 run create_hlr_db(pid=13454): Terminated: ok {rc=0} 13:25:10.870453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13456): Launched 13:25:11.164106 run osmo-hlr_10.42.42.2(pid=13457): Launched 13:25:11.276165 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:11.796408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13459): Launched 13:25:12.090174 run osmo-stp_10.42.42.5(pid=13460): Launched 13:25:12.202789 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:12.710384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13462): Launched 13:25:12.823146 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:13.071862 run patchelf(pid=13463): Launched 13:25:13.236179 run osmo-stp_10.42.42.5(pid=13460): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13460)] 13:25:13.361232 run osmo-stp_10.42.42.5(pid=13460): stdout: | (launched: 2022-12-10_13:25:12.036266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:13.487982 run osmo-stp_10.42.42.5(pid=13460): stderr: | [0;m[38;5;43m20221210132512207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132512207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132512207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132512207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132512208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132512208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132512208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:13.614658 run osmo-stp_10.42.42.5(pid=13460): stdout: | (launched: 2022-12-10_13:25:12.036266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:13.735948 run osmo-stp_10.42.42.5(pid=13460): stderr: | [0;m[38;5;43m20221210132512207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132512207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132512207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132512207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132512208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132512208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132512208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:13.879166 run patchelf(pid=13463): Terminating (SIGINT) 13:25:14.045693 run patchelf(pid=13463): Terminated: ok {rc=0} 13:25:14.165631 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13460): Process ended prematurely: osmo-stp_10.42.42.5(pid=13460) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13460)] [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:25:14.174375 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:25:14.201692 run osmo-hlr_10.42.42.2(pid=13457): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13457)] 13:25:14.249706 run osmo-hlr_10.42.42.2(pid=13457): stdout: | (launched: 2022-12-10_13:25:11.110190) 13:25:14.298624 run osmo-hlr_10.42.42.2(pid=13457): stderr: | [0;m[1;31m20221210132511284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132511284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132511284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132511284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132511284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132511284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132511296 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132511304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132511305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132511305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:14.348720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13456): Terminating (SIGTERM) 13:25:14.388557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13459): Terminating (SIGTERM) 13:25:14.428330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13462): Terminating (SIGTERM) 13:25:14.468636 --- ParallelTerminationStrategy: PID 13456 died... 13:25:14.487632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13456): Terminated: ok {rc=0} 13:25:14.531736 --- ParallelTerminationStrategy: PID 13459 died... 13:25:14.550254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13459): Terminated: ok {rc=0} 13:25:14.594383 --- ParallelTerminationStrategy: PID 13462 died... 13:25:14.612782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13462): Terminated: ok {rc=0} 13:25:14.696715 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:25:16.022192 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:25:16.034072 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:25:16.070851 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 13:25:16.111982 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 13:25:16.202633 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:25:16.238054 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 13:25:16.279645 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 13:25:16.879518 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 13:25:16.930779 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:16.943676 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:25:16.994767 tst cs_paging_gprs_active.py: using LAC 28698 13:25:17.112111 tst cs_paging_gprs_active.py: using RAC 138 13:25:17.229578 tst cs_paging_gprs_active.py: using CellId 28698 13:25:17.346292 tst cs_paging_gprs_active.py: using BVCI 28699 13:25:17.454755 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:17.465822 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:17.476706 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:17.487870 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:17.499041 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:17.510158 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:17.521382 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:17.532230 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:17.543489 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:25:17.662089 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:25:17.780175 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:25:17.980143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:18.278928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13467): Launched 13:25:18.538348 run iperf3-srv_10.42.42.10(pid=13468): Launched 13:25:18.650151 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:25:18.849539 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:19.147908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13469): Launched 13:25:19.406644 run iperf3-srv_10.42.42.10(pid=13470): Launched 13:25:19.518107 tst cs_paging_gprs_active.py:38: start network... 13:25:19.716266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:20.177033 run create_hlr_db(pid=13471): Launched 13:25:20.290388 bus /gobi_6: Setting Powered False 13:25:21.350217 run create_hlr_db(pid=13471): Terminated: ok {rc=0} 13:25:21.784843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13473): Launched 13:25:22.102930 run osmo-hlr_10.42.42.2(pid=13474): Launched 13:25:22.224188 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:22.770533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13476): Launched 13:25:23.085794 run osmo-stp_10.42.42.5(pid=13477): Launched 13:25:23.206116 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:23.752118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13479): Launched 13:25:23.873737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:24.141464 run patchelf(pid=13480): Launched 13:25:24.318130 run osmo-stp_10.42.42.5(pid=13477): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13477)] 13:25:24.453058 run osmo-stp_10.42.42.5(pid=13477): stdout: | (launched: 2022-12-10_13:25:23.028572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:24.589473 run osmo-stp_10.42.42.5(pid=13477): stderr: | [0;m[38;5;43m20221210132523219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132523219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132523219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132523220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132523220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132523220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132523220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:24.725302 run osmo-stp_10.42.42.5(pid=13477): stdout: | (launched: 2022-12-10_13:25:23.028572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:24.855541 run osmo-stp_10.42.42.5(pid=13477): stderr: | [0;m[38;5;43m20221210132523219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132523219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132523219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132523220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132523220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132523220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132523220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:25.009826 run patchelf(pid=13480): Terminating (SIGINT) 13:25:25.187955 run patchelf(pid=13480): Terminated: ok {rc=0} 13:25:25.316655 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13477): Process ended prematurely: osmo-stp_10.42.42.5(pid=13477) [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13477)] [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 13:25:25.326741 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 13:25:25.354835 run osmo-hlr_10.42.42.2(pid=13474): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13474)] 13:25:25.404237 run osmo-hlr_10.42.42.2(pid=13474): stdout: | (launched: 2022-12-10_13:25:22.045351) 13:25:25.455138 run osmo-hlr_10.42.42.2(pid=13474): stderr: | [0;m[1;31m20221210132522244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132522244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132522244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132522244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132522244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132522244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132522257 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132522265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132522265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132522265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:25.507126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13467): Terminating (SIGTERM) 13:25:25.548194 run iperf3-srv_10.42.42.10(pid=13468): Terminating (SIGTERM) 13:25:25.589479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13469): Terminating (SIGTERM) 13:25:25.630606 run iperf3-srv_10.42.42.10(pid=13470): Terminating (SIGTERM) 13:25:25.671618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13473): Terminating (SIGTERM) 13:25:25.712662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13476): Terminating (SIGTERM) 13:25:25.753820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13479): Terminating (SIGTERM) 13:25:25.795158 --- ParallelTerminationStrategy: PID 13467 died... 13:25:25.814834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13467): Terminated: ok {rc=0} 13:25:25.860444 --- ParallelTerminationStrategy: PID 13468 died... 13:25:25.879548 run iperf3-srv_10.42.42.10(pid=13468): Terminated {rc=256} 13:25:25.924596 --- ParallelTerminationStrategy: PID 13469 died... 13:25:25.943763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13469): Terminated: ok {rc=0} 13:25:25.988800 --- ParallelTerminationStrategy: PID 13470 died... 13:25:26.008241 run iperf3-srv_10.42.42.10(pid=13470): Terminated {rc=256} 13:25:26.053265 --- ParallelTerminationStrategy: PID 13473 died... 13:25:26.072351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13473): Terminated: ok {rc=0} 13:25:26.117586 --- ParallelTerminationStrategy: PID 13476 died... 13:25:26.136626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13476): Terminated: ok {rc=0} 13:25:26.181999 --- ParallelTerminationStrategy: PID 13479 died... 13:25:26.201199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13479): Terminated: ok {rc=0} 13:25:26.288096 bus /gobi_0: Setting Powered False 13:25:27.387081 bus /gobi_0: Setting Powered False 13:25:28.503643 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 13:25:29.646947 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:29.658626 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:25:29.711976 tst iperf3.py: using LAC 28699 13:25:29.830915 tst iperf3.py: using RAC 139 13:25:29.947894 tst iperf3.py: using CellId 28699 13:25:30.066920 tst iperf3.py: using BVCI 28700 13:25:30.175590 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:30.186722 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:30.197633 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:30.208674 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:30.219804 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:30.230932 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:30.242093 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:30.253116 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:30.264271 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:25:30.378562 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:25:30.578402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:30.885698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13481): Launched 13:25:31.206217 run iperf3-srv_10.42.42.10(pid=13482): Launched 13:25:31.338274 tst iperf3.py:8: start network... 13:25:31.559361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:32.066477 run create_hlr_db(pid=13483): Launched 13:25:32.225515 bus /gobi_6: Setting Powered False 13:25:33.288041 run create_hlr_db(pid=13483): Terminated: ok {rc=0} 13:25:33.710061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13485): Launched 13:25:34.006252 run osmo-hlr_10.42.42.2(pid=13486): Launched 13:25:34.119331 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:34.654049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13488): Launched 13:25:34.949013 run osmo-stp_10.42.42.5(pid=13489): Launched 13:25:35.062213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:35.573689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13491): Launched 13:25:35.687260 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:35.940094 run patchelf(pid=13492): Launched 13:25:36.105384 run osmo-stp_10.42.42.5(pid=13489): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13489)] 13:25:36.231167 run osmo-stp_10.42.42.5(pid=13489): stdout: | (launched: 2022-12-10_13:25:34.894583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:36.358562 run osmo-stp_10.42.42.5(pid=13489): stderr: | [0;m[38;5;43m20221210132535063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132535063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132535064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132535064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132535065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132535065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132535065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:36.486821 run osmo-stp_10.42.42.5(pid=13489): stdout: | (launched: 2022-12-10_13:25:34.894583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:36.608743 run osmo-stp_10.42.42.5(pid=13489): stderr: | [0;m[38;5;43m20221210132535063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132535063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132535064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132535064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132535065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132535065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132535065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:36.753176 run patchelf(pid=13492): Terminating (SIGINT) 13:25:36.921227 run patchelf(pid=13492): Terminated: ok {rc=0} 13:25:37.042029 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13489): Process ended prematurely: osmo-stp_10.42.42.5(pid=13489) [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13489)] [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 13:25:37.051276 tst iperf3.py:8: Test FAILED (7.4 sec) 13:25:37.078599 run osmo-hlr_10.42.42.2(pid=13486): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13486)] 13:25:37.125903 run osmo-hlr_10.42.42.2(pid=13486): stdout: | (launched: 2022-12-10_13:25:33.951934) 13:25:37.174578 run osmo-hlr_10.42.42.2(pid=13486): stderr: | [0;m[1;31m20221210132534130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132534130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132534130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132534130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132534130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132534130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132534141 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132534150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132534150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132534150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:37.223730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13481): Terminating (SIGTERM) 13:25:37.263040 run iperf3-srv_10.42.42.10(pid=13482): Terminating (SIGTERM) 13:25:37.302135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13485): Terminating (SIGTERM) 13:25:37.341252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13488): Terminating (SIGTERM) 13:25:37.380594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13491): Terminating (SIGTERM) 13:25:37.419912 --- ParallelTerminationStrategy: PID 13481 died... 13:25:37.438514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13481): Terminated: ok {rc=0} 13:25:37.481896 --- ParallelTerminationStrategy: PID 13482 died... 13:25:37.499970 run iperf3-srv_10.42.42.10(pid=13482): Terminated {rc=256} 13:25:37.543266 --- ParallelTerminationStrategy: PID 13485 died... 13:25:37.561439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13485): Terminated: ok {rc=0} 13:25:37.604674 --- ParallelTerminationStrategy: PID 13488 died... 13:25:37.622905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13488): Terminated: ok {rc=0} 13:25:37.666234 --- ParallelTerminationStrategy: PID 13491 died... 13:25:37.684392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13491): Terminated: ok {rc=0} 13:25:37.766843 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 13:25:38.913086 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:38.925198 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:25:38.979148 tst iperf3m4.py: using LAC 28700 13:25:39.105406 tst iperf3m4.py: using RAC 140 13:25:39.230254 tst iperf3m4.py: using CellId 28700 13:25:39.357410 tst iperf3m4.py: using BVCI 28701 13:25:39.472368 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:39.483900 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:39.495277 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:39.506725 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:39.519074 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:39.530712 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:39.542373 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:39.553840 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:39.565772 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:25:39.683156 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:25:39.801091 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:25:39.918486 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:25:40.038249 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:25:40.251951 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:40.569563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13493): Launched 13:25:40.843964 run iperf3-srv_10.42.42.10(pid=13494): Launched 13:25:40.962182 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:25:41.174652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:41.491107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13495): Launched 13:25:41.765293 run iperf3-srv_10.42.42.10(pid=13496): Launched 13:25:41.893460 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:25:42.094310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:42.392535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13497): Launched 13:25:42.651275 run iperf3-srv_10.42.42.10(pid=13498): Launched 13:25:42.762322 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:25:42.960846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:43.258527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13499): Launched 13:25:43.516553 run iperf3-srv_10.42.42.10(pid=13500): Launched 13:25:43.628026 tst iperf3m4.py:8: start network... 13:25:43.827292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:44.288681 run create_hlr_db(pid=13501): Launched 13:25:44.421149 bus /gobi_6: Setting Powered False 13:25:45.483975 run create_hlr_db(pid=13501): Terminated: ok {rc=0} 13:25:45.943525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13503): Launched 13:25:46.291097 run osmo-hlr_10.42.42.2(pid=13504): Launched 13:25:46.543103 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:47.189880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13506): Launched 13:25:47.537167 run osmo-stp_10.42.42.5(pid=13507): Launched 13:25:47.659302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:48.206767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13509): Launched 13:25:48.327162 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:48.595680 run patchelf(pid=13510): Launched 13:25:48.771255 run osmo-stp_10.42.42.5(pid=13507): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13507)] 13:25:48.905216 run osmo-stp_10.42.42.5(pid=13507): stdout: | (launched: 2022-12-10_13:25:47.478880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:49.040625 run osmo-stp_10.42.42.5(pid=13507): stderr: | [0;m[38;5;43m20221210132547670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132547670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132547671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132547671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132547671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132547671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132547672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:49.176252 run osmo-stp_10.42.42.5(pid=13507): stdout: | (launched: 2022-12-10_13:25:47.478880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:49.306599 run osmo-stp_10.42.42.5(pid=13507): stderr: | [0;m[38;5;43m20221210132547670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132547670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132547671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132547671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132547671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132547671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132547672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:49.460677 run patchelf(pid=13510): Terminating (SIGINT) 13:25:49.639273 run patchelf(pid=13510): Terminated: ok {rc=0} 13:25:49.767438 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13507): Process ended prematurely: osmo-stp_10.42.42.5(pid=13507) [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13507)] [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 13:25:49.777423 tst iperf3m4.py:8: Test FAILED (10.9 sec) 13:25:49.805797 run osmo-hlr_10.42.42.2(pid=13504): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13504)] 13:25:49.855075 run osmo-hlr_10.42.42.2(pid=13504): stdout: | (launched: 2022-12-10_13:25:46.225307) 13:25:49.906627 run osmo-hlr_10.42.42.2(pid=13504): stderr: | [0;m[1;31m20221210132546523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132546523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132546523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132546523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132546523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132546523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132546537 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132546553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132546554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132546554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:49.958301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13493): Terminating (SIGTERM) 13:25:49.999311 run iperf3-srv_10.42.42.10(pid=13494): Terminating (SIGTERM) 13:25:50.040337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13495): Terminating (SIGTERM) 13:25:50.081589 run iperf3-srv_10.42.42.10(pid=13496): Terminating (SIGTERM) 13:25:50.122769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13497): Terminating (SIGTERM) 13:25:50.164164 run iperf3-srv_10.42.42.10(pid=13498): Terminating (SIGTERM) 13:25:50.205343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13499): Terminating (SIGTERM) 13:25:50.246527 run iperf3-srv_10.42.42.10(pid=13500): Terminating (SIGTERM) 13:25:50.287703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13503): Terminating (SIGTERM) 13:25:50.328779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13506): Terminating (SIGTERM) 13:25:50.370110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13509): Terminating (SIGTERM) 13:25:50.411592 --- ParallelTerminationStrategy: PID 13493 died... 13:25:50.431176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13493): Terminated: ok {rc=0} 13:25:50.476715 --- ParallelTerminationStrategy: PID 13494 died... 13:25:50.495958 run iperf3-srv_10.42.42.10(pid=13494): Terminated {rc=256} 13:25:50.541805 --- ParallelTerminationStrategy: PID 13495 died... 13:25:50.561242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13495): Terminated: ok {rc=0} 13:25:50.606644 --- ParallelTerminationStrategy: PID 13496 died... 13:25:50.625850 run iperf3-srv_10.42.42.10(pid=13496): Terminated {rc=256} 13:25:50.671024 --- ParallelTerminationStrategy: PID 13497 died... 13:25:50.690184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13497): Terminated: ok {rc=0} 13:25:50.735406 --- ParallelTerminationStrategy: PID 13498 died... 13:25:50.754674 run iperf3-srv_10.42.42.10(pid=13498): Terminated {rc=256} 13:25:50.799759 --- ParallelTerminationStrategy: PID 13499 died... 13:25:50.819119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13499): Terminated: ok {rc=0} 13:25:50.864373 --- ParallelTerminationStrategy: PID 13500 died... 13:25:50.883662 run iperf3-srv_10.42.42.10(pid=13500): Terminated {rc=256} 13:25:50.928927 --- ParallelTerminationStrategy: PID 13503 died... 13:25:50.948217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13503): Terminated: ok {rc=0} 13:25:50.993544 --- ParallelTerminationStrategy: PID 13506 died... 13:25:51.012698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13506): Terminated: ok {rc=0} 13:25:51.058169 --- ParallelTerminationStrategy: PID 13509 died... 13:25:51.077504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13509): Terminated: ok {rc=0} 13:25:51.165100 bus /gobi_4: Setting Powered False 13:25:52.261172 bus /gobi_4: Setting Powered False 13:25:53.375018 bus /gobi_1: Setting Powered False 13:25:54.472389 bus /gobi_1: Setting Powered False 13:25:55.586173 bus /gobi_0: Setting Powered False 13:25:56.683050 bus /gobi_0: Setting Powered False 13:25:57.798589 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 13:25:58.899892 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:58.911547 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:25:58.962555 tst ping.py: using LAC 28701 13:25:59.079099 tst ping.py: using RAC 141 13:25:59.193962 tst ping.py: using CellId 28701 13:25:59.309567 tst ping.py: using BVCI 28702 13:25:59.424449 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:59.436254 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:59.447912 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:59.459955 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:59.471931 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:59.483960 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:59.496092 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:25:59.508080 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:25:59.624608 tst ping.py:19: start network... 13:25:59.819880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:00.270586 run create_hlr_db(pid=13511): Launched 13:26:00.382024 bus /gobi_6: Setting Powered False 13:26:01.460051 run create_hlr_db(pid=13511): Terminated: ok {rc=0} 13:26:01.929660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13513): Launched 13:26:02.252471 run osmo-hlr_10.42.42.2(pid=13514): Launched 13:26:02.373691 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:02.880539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13516): Launched 13:26:03.171637 run osmo-stp_10.42.42.5(pid=13517): Launched 13:26:03.282857 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:03.786763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13519): Launched 13:26:03.898061 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:04.145417 run patchelf(pid=13520): Launched 13:26:04.308882 run osmo-stp_10.42.42.5(pid=13517): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13517)] 13:26:04.434144 run osmo-stp_10.42.42.5(pid=13517): stdout: | (launched: 2022-12-10_13:26:03.118287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:04.560700 run osmo-stp_10.42.42.5(pid=13517): stderr: | [0;m[38;5;43m20221210132603286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132603286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132603286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132603287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132603289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132603289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132603289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:04.687821 run osmo-stp_10.42.42.5(pid=13517): stdout: | (launched: 2022-12-10_13:26:03.118287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:04.809405 run osmo-stp_10.42.42.5(pid=13517): stderr: | [0;m[38;5;43m20221210132603286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132603286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132603286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132603287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132603289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132603289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132603289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:04.953395 run patchelf(pid=13520): Terminating (SIGINT) 13:26:05.118846 run patchelf(pid=13520): Terminated: ok {rc=0} 13:26:05.238000 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13517): Process ended prematurely: osmo-stp_10.42.42.5(pid=13517) [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13517)] [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 13:26:05.246689 tst ping.py:22: Test FAILED (6.3 sec) 13:26:05.273425 run osmo-hlr_10.42.42.2(pid=13514): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13514)] 13:26:05.320894 run osmo-hlr_10.42.42.2(pid=13514): stdout: | (launched: 2022-12-10_13:26:02.182981) 13:26:05.369876 run osmo-hlr_10.42.42.2(pid=13514): stderr: | [0;m[1;31m20221210132602388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132602388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132602388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132602388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132602388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132602388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132602400 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132602408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132602409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132602409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:05.419370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13513): Terminating (SIGTERM) 13:26:05.458833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13516): Terminating (SIGTERM) 13:26:05.498311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13519): Terminating (SIGTERM) 13:26:05.538076 --- ParallelTerminationStrategy: PID 13513 died... 13:26:05.556803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13513): Terminated: ok {rc=0} 13:26:05.600550 --- ParallelTerminationStrategy: PID 13516 died... 13:26:05.618927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13516): Terminated: ok {rc=0} 13:26:05.662525 --- ParallelTerminationStrategy: PID 13519 died... 13:26:05.681284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13519): Terminated: ok {rc=0} 13:26:05.766487 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 13:26:06.854152 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:26:06.865994 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:26:06.920280 tst ping_idle_ping.py: using LAC 28702 13:26:07.035143 tst ping_idle_ping.py: using RAC 142 13:26:07.149274 tst ping_idle_ping.py: using CellId 28702 13:26:07.262879 tst ping_idle_ping.py: using BVCI 28703 13:26:07.369995 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:26:07.381206 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:26:07.392083 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:26:07.403228 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:26:07.414418 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:26:07.425731 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:26:07.436905 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:26:07.448047 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:26:07.567923 tst ping_idle_ping.py:24: start network... 13:26:07.778688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:08.264409 run create_hlr_db(pid=13521): Launched 13:26:08.392019 bus /gobi_6: Setting Powered False 13:26:09.454477 run create_hlr_db(pid=13521): Terminated: ok {rc=0} 13:26:09.889807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13523): Launched 13:26:10.201724 run osmo-hlr_10.42.42.2(pid=13524): Launched 13:26:10.320699 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:10.861875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13526): Launched 13:26:11.173604 run osmo-stp_10.42.42.5(pid=13527): Launched 13:26:11.292736 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:11.834116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13529): Launched 13:26:11.953116 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:12.217153 run patchelf(pid=13530): Launched 13:26:12.391486 run osmo-stp_10.42.42.5(pid=13527): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13527)] 13:26:12.524302 run osmo-stp_10.42.42.5(pid=13527): stdout: | (launched: 2022-12-10_13:26:11.116735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:12.658801 run osmo-stp_10.42.42.5(pid=13527): stderr: | [0;m[38;5;43m20221210132611307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132611307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132611308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132611308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132611308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132611309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132611309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:12.793387 run osmo-stp_10.42.42.5(pid=13527): stdout: | (launched: 2022-12-10_13:26:11.116735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:12.922304 run osmo-stp_10.42.42.5(pid=13527): stderr: | [0;m[38;5;43m20221210132611307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132611307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132611308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132611308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132611308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132611309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132611309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:13.075070 run patchelf(pid=13530): Terminating (SIGINT) 13:26:13.251259 run patchelf(pid=13530): Terminated: ok {rc=0} 13:26:13.378264 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13527): Process ended prematurely: osmo-stp_10.42.42.5(pid=13527) [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13527)] [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 13:26:13.387661 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:26:13.415078 run osmo-hlr_10.42.42.2(pid=13524): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13524)] 13:26:13.464619 run osmo-hlr_10.42.42.2(pid=13524): stdout: | (launched: 2022-12-10_13:26:10.145063) 13:26:13.515528 run osmo-hlr_10.42.42.2(pid=13524): stderr: | [0;m[1;31m20221210132610342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132610342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132610342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132610342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132610342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132610342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132610353 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132610362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132610362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132610362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:13.567433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13523): Terminating (SIGTERM) 13:26:13.608865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13526): Terminating (SIGTERM) 13:26:13.650375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13529): Terminating (SIGTERM) 13:26:13.692273 --- ParallelTerminationStrategy: PID 13523 died... 13:26:13.712065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13523): Terminated: ok {rc=0} 13:26:13.758217 --- ParallelTerminationStrategy: PID 13526 died... 13:26:13.777715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13526): Terminated: ok {rc=0} 13:26:13.823310 --- ParallelTerminationStrategy: PID 13529 died... 13:26:13.842840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13529): Terminated: ok {rc=0} 13:26:13.930181 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:26:15.238521 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:26:15.245790 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:26:15.278000 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:26:15.312067 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:26:15.364346 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:26:15.396342 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:26:15.430318 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:26:16.010710 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:26:16.016897 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:26:16.028659 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:26:16.099098 tst switch_tch_pdch.py: using LAC 28703 13:26:16.224731 tst switch_tch_pdch.py: using RAC 143 13:26:16.376385 tst switch_tch_pdch.py: using CellId 28703 13:26:16.496691 tst switch_tch_pdch.py: using BVCI 28704 13:26:16.613291 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:26:16.625729 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:26:16.637997 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:26:16.650602 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:26:16.663611 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:26:16.675843 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:26:16.688205 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:26:16.700736 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:26:16.825300 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:26:16.978864 tst switch_tch_pdch.py:51: start network... 13:26:17.199998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:17.658719 run create_hlr_db(pid=13534): Launched 13:26:17.771075 bus /gobi_6: Setting Powered False 13:26:18.829538 run create_hlr_db(pid=13534): Terminated: ok {rc=0} 13:26:19.256375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13536): Launched 13:26:19.552819 run osmo-hlr_10.42.42.2(pid=13537): Launched 13:26:19.664582 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:20.180054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13539): Launched 13:26:20.472759 run osmo-stp_10.42.42.5(pid=13540): Launched 13:26:20.584655 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:21.087266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13542): Launched 13:26:21.198773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:21.445312 run patchelf(pid=13543): Launched 13:26:21.608524 run osmo-stp_10.42.42.5(pid=13540): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13540)] 13:26:21.732617 run osmo-stp_10.42.42.5(pid=13540): stdout: | (launched: 2022-12-10_13:26:20.419233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:21.858526 run osmo-stp_10.42.42.5(pid=13540): stderr: | [0;m[38;5;43m20221210132620589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132620589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132620589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132620590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132620590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132620590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132620590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:21.984342 run osmo-stp_10.42.42.5(pid=13540): stdout: | (launched: 2022-12-10_13:26:20.419233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:22.104824 run osmo-stp_10.42.42.5(pid=13540): stderr: | [0;m[38;5;43m20221210132620589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132620589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132620589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132620590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132620590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132620590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132620590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:22.247472 run patchelf(pid=13543): Terminating (SIGINT) 13:26:22.412684 run patchelf(pid=13543): Terminated: ok {rc=0} 13:26:22.531820 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13540): Process ended prematurely: osmo-stp_10.42.42.5(pid=13540) [trial-2375↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13540)] [trial-2375↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:26:22.540824 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 13:26:22.567354 run osmo-hlr_10.42.42.2(pid=13537): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13537)] 13:26:22.614379 run osmo-hlr_10.42.42.2(pid=13537): stdout: | (launched: 2022-12-10_13:26:19.499079) 13:26:22.663106 run osmo-hlr_10.42.42.2(pid=13537): stderr: | [0;m[1;31m20221210132619673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132619673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132619674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132619674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132619674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132619674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132619686 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132619696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132619696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132619696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:22.712423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13536): Terminating (SIGTERM) 13:26:22.752084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13539): Terminating (SIGTERM) 13:26:22.792138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13542): Terminating (SIGTERM) 13:26:22.832080 --- ParallelTerminationStrategy: PID 13536 died... 13:26:22.850933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13536): Terminated: ok {rc=0} 13:26:22.894746 --- ParallelTerminationStrategy: PID 13539 died... 13:26:22.913119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13539): Terminated: ok {rc=0} 13:26:22.956777 --- ParallelTerminationStrategy: PID 13542 died... 13:26:22.975249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13542): Terminated: ok {rc=0} 13:26:23.060180 bus /gobi_0: Setting Powered False 13:26:24.158836 bus /gobi_0: Setting Powered False 13:26:25.273383 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:26:26.526274 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:26:26.532563 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:26:26.565694 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:26:26.600324 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:26:26.654489 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:26:26.688182 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:26:26.722844 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:26:27.277294 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:26:27.282400 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:26:27.293666 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:26:27.362562 tst switch_tch_pdch.py: using LAC 28704 13:26:27.479014 tst switch_tch_pdch.py: using RAC 144 13:26:27.601367 tst switch_tch_pdch.py: using CellId 28704 13:26:27.729245 tst switch_tch_pdch.py: using BVCI 28705 13:26:27.842863 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:26:27.854125 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:26:27.865107 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:26:27.876068 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:26:27.886979 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:26:27.898025 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:26:27.909188 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:26:27.920069 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:26:28.035531 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:26:28.151606 tst switch_tch_pdch.py:51: start network... 13:26:28.359868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:28.813455 run create_hlr_db(pid=13548): Launched 13:26:28.940645 bus /gobi_6: Setting Powered False 13:26:30.002383 run create_hlr_db(pid=13548): Terminated: ok {rc=0} 13:26:30.394142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13550): Launched 13:26:30.704530 run osmo-hlr_10.42.42.2(pid=13551): Launched 13:26:30.823027 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:31.494387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13553): Launched 13:26:31.819034 run osmo-stp_10.42.42.5(pid=13554): Launched 13:26:31.982652 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:32.678192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13556): Launched 13:26:32.797258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:33.060291 run patchelf(pid=13557): Launched 13:26:33.232854 run osmo-stp_10.42.42.5(pid=13554): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13554)] 13:26:33.365153 run osmo-stp_10.42.42.5(pid=13554): stdout: | (launched: 2022-12-10_13:26:31.756540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:33.498822 run osmo-stp_10.42.42.5(pid=13554): stderr: | [0;m[38;5;43m20221210132632110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132632110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132632110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132632111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132632117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132632117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132632117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:33.632863 run osmo-stp_10.42.42.5(pid=13554): stdout: | (launched: 2022-12-10_13:26:31.756540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:33.760910 run osmo-stp_10.42.42.5(pid=13554): stderr: | [0;m[38;5;43m20221210132632110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132632110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132632110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132632111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132632117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132632117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132632117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:33.911921 run patchelf(pid=13557): Terminating (SIGINT) 13:26:34.086818 run patchelf(pid=13557): Terminated: ok {rc=0} 13:26:34.213444 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13554): Process ended prematurely: osmo-stp_10.42.42.5(pid=13554) [trial-2375↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13554)] [trial-2375↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:26:34.223109 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 13:26:34.250702 run osmo-hlr_10.42.42.2(pid=13551): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13551)] 13:26:34.300055 run osmo-hlr_10.42.42.2(pid=13551): stdout: | (launched: 2022-12-10_13:26:30.648111) 13:26:34.351476 run osmo-hlr_10.42.42.2(pid=13551): stderr: | [0;m[1;31m20221210132630847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132630847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132630847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132630847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132630847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132630847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132630868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132630883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132630883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132630883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:34.402930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13550): Terminating (SIGTERM) 13:26:34.444109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13553): Terminating (SIGTERM) 13:26:34.485465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13556): Terminating (SIGTERM) 13:26:34.527136 --- ParallelTerminationStrategy: PID 13550 died... 13:26:34.547099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13550): Terminated: ok {rc=0} 13:26:34.592769 --- ParallelTerminationStrategy: PID 13553 died... 13:26:34.612162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13553): Terminated: ok {rc=0} 13:26:34.657485 --- ParallelTerminationStrategy: PID 13556 died... 13:26:34.676860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13556): Terminated: ok {rc=0} 13:26:34.763887 bus /gobi_0: Setting Powered False 13:26:35.862045 bus /gobi_0: Setting Powered False 13:26:36.977263 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_sms:trx-lms --------------------------------------------------------------------- 13:26:38.222948 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:26:38.227527 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 13:26:38.261356 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 13:26:38.267952 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 13:26:38.318489 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 13:26:38.351334 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 13:26:38.357881 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 13:26:38.897755 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 13:26:38.903151 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 13:26:38.914583 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 13:26:38.964493 tst mo_mt_sms.py: using LAC 28705 13:26:39.086393 tst mo_mt_sms.py: using RAC 145 13:26:39.209466 tst mo_mt_sms.py: using CellId 28705 13:26:39.335308 tst mo_mt_sms.py: using BVCI 28706 13:26:39.448635 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 13:26:39.562984 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 13:26:39.678721 tst mo_mt_sms.py:9: start nitb and bts... 13:26:39.888207 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:26:40.519762 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13562): Launched 13:26:40.830714 run osmo-nitb_10.42.42.2(pid=13563): Launched 13:26:41.003256 run osmo-nitb_10.42.42.2(pid=13563): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13563)] 13:26:41.143074 run osmo-nitb_10.42.42.2(pid=13563): stdout: | (launched: 2022-12-10_13:26:40.774257) 13:26:41.283652 run osmo-nitb_10.42.42.2(pid=13563): stderr: | (launched: 2022-12-10_13:26:40.820725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:26:41.423980 run osmo-nitb_10.42.42.2(pid=13563): stdout: | (launched: 2022-12-10_13:26:40.774257) 13:26:41.559817 run osmo-nitb_10.42.42.2(pid=13563): stderr: | (launched: 2022-12-10_13:26:40.820725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13563): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13563) [trial-2375↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13563)] 13:26:41.948686 tst osmo-nitb_10.42.42.2(pid=13563): stdout: | (launched: 2022-12-10_13:26:40.774257) 13:26:42.073923 tst osmo-nitb_10.42.42.2(pid=13563): stderr: | (launched: 2022-12-10_13:26:40.820725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:26:42.221720 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=13563): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13563) [trial-2375↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13563)] [trial-2375↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 13:26:42.230780 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 13:26:42.238029 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13562): Terminating (SIGTERM) 13:26:42.447770 --- ParallelTerminationStrategy: PID 13562 died... 13:26:42.468935 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13562): Terminated: ok {rc=0} 13:26:42.555211 bus /sierra_3: Setting Powered False 13:26:43.653333 bus /sierra_3: Setting Powered False 13:26:44.770697 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 sms:trx-lms --------------------------------------------------------------------- 13:26:45.996147 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:26:46.000779 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 13:26:46.045214 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 13:26:46.080267 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 13:26:46.136199 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 13:26:46.177186 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 13:26:46.212670 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 13:26:46.737894 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 13:26:46.742861 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:26:46.753976 tst sms:trx-lms: Using 1 x bts (candidates: 1) 13:26:46.801605 tst mo_mt_sms.py: using LAC 28706 13:26:46.932531 tst mo_mt_sms.py: using RAC 146 13:26:47.074159 tst mo_mt_sms.py: using CellId 28706 13:26:47.193266 tst mo_mt_sms.py: using BVCI 28707 13:26:47.309431 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:26:47.320554 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:26:47.332201 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:26:47.343224 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:26:47.353867 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:26:47.364619 tst sms:trx-lms: Using 1 x modem (candidates: 2) 13:26:47.481626 tst sms:trx-lms: Using 1 x modem (candidates: 2) 13:26:47.603073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:48.084208 run create_hlr_db(pid=13567): Launched 13:26:48.210188 bus /sierra_2: Setting Powered False 13:26:49.271991 run create_hlr_db(pid=13567): Terminated: ok {rc=0} 13:26:49.705289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13569): Launched 13:26:50.015015 run osmo-hlr_10.42.42.2(pid=13570): Launched 13:26:50.132445 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:50.671836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13572): Launched 13:26:50.981123 run osmo-stp_10.42.42.5(pid=13573): Launched 13:26:51.099365 run osmo-msc_10.42.42.6: Starting osmo-msc 13:26:51.660364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13575): Launched 13:26:51.969733 run osmo-msc_10.42.42.6(pid=13576): Launched 13:26:52.143228 run osmo-stp_10.42.42.5(pid=13573): ERR: Terminated: ERROR {rc=1} [trial-2375↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13573)] 13:26:52.274925 run osmo-stp_10.42.42.5(pid=13573): stdout: | (launched: 2022-12-10_13:26:50.924770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:52.406872 run osmo-stp_10.42.42.5(pid=13573): stderr: | [0;m[38;5;43m20221210132651116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132651116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132651116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132651117 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132651117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132651117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132651117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:52.538391 run osmo-stp_10.42.42.5(pid=13573): stdout: | (launched: 2022-12-10_13:26:50.924770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:52.662483 run osmo-stp_10.42.42.5(pid=13573): stderr: | [0;m[38;5;43m20221210132651116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132651116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132651116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132651117 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132651117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132651117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132651117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:52.809948 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=13573): Process ended prematurely: osmo-stp_10.42.42.5(pid=13573) [trial-2375↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13573)] [trial-2375↪sms:trx-lms↪mo_mt_sms.py:16] 13:26:52.818494 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 13:26:52.845186 run osmo-hlr_10.42.42.2(pid=13570): ERR: Terminated: ERROR {rc=237} [trial-2375↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13570)] 13:26:52.894670 run osmo-hlr_10.42.42.2(pid=13570): stdout: | (launched: 2022-12-10_13:26:49.958586) 13:26:52.945761 run osmo-hlr_10.42.42.2(pid=13570): stderr: | [0;m[1;31m20221210132650157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132650157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132650157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132650157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132650157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132650157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132650169 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132650178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132650178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132650178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:53.017116 run osmo-msc_10.42.42.6(pid=13576): ERR: Terminated: ERROR {rc=2} [trial-2375↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13576)] 13:26:53.066425 run osmo-msc_10.42.42.6(pid=13576): stdout: | (launched: 2022-12-10_13:26:51.913305) 13:26:53.117295 run osmo-msc_10.42.42.6(pid=13576): stderr: | [0;m[38;5;43m20221210132652232 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132652232 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9a6f78dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132652232 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132652232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132652232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132652232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132652234 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132652234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132652235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132652235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:26:53.168559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13569): Terminating (SIGTERM) 13:26:53.209522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13572): Terminating (SIGTERM) 13:26:53.250552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13575): Terminating (SIGTERM) 13:26:53.291722 --- ParallelTerminationStrategy: PID 13569 died... 13:26:53.311234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13569): Terminated: ok {rc=0} 13:26:53.356852 --- ParallelTerminationStrategy: PID 13572 died... 13:26:53.375971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13572): Terminated: ok {rc=0} 13:26:53.421142 --- ParallelTerminationStrategy: PID 13575 died... 13:26:53.440081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13575): Terminated: ok {rc=0} 13:26:53.526552 bus /sierra_3: Setting Powered False 13:26:54.623986 bus /sierra_3: Setting Powered False 13:26:55.737290 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_ussd:trx-lms --------------------------------------------------------------------- 13:26:56.966696 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:26:56.971164 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 13:26:57.004538 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 13:26:57.011128 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 13:26:57.047041 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 13:26:57.080459 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 13:26:57.087492 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 13:26:57.603174 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2375 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 13:26:57.608273 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 13:26:57.618882 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 13:26:57.665426 tst assert_extension.py: using LAC 28707 13:26:57.781478 tst assert_extension.py: using RAC 147 13:26:57.904666 tst assert_extension.py: using CellId 28707 13:26:58.026916 tst assert_extension.py: using BVCI 28708 13:26:58.139866 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 13:26:58.252610 tst assert_extension.py:10: start nitb and bts... 13:26:58.449184 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:26:59.045762 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13582): Launched 13:26:59.338284 run osmo-nitb_10.42.42.2(pid=13583): Launched 13:26:59.499471 run osmo-nitb_10.42.42.2(pid=13583): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13583)] 13:26:59.630731 run osmo-nitb_10.42.42.2(pid=13583): stdout: | (launched: 2022-12-10_13:26:59.284572) 13:26:59.762741 run osmo-nitb_10.42.42.2(pid=13583): stderr: | (launched: 2022-12-10_13:26:59.328346) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:26:59.894795 run osmo-nitb_10.42.42.2(pid=13583): stdout: | (launched: 2022-12-10_13:26:59.284572) 13:27:00.021333 run osmo-nitb_10.42.42.2(pid=13583): stderr: | (launched: 2022-12-10_13:26:59.328346) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13583): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13583) [trial-2375↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13583)] 13:27:00.448458 tst osmo-nitb_10.42.42.2(pid=13583): stdout: | (launched: 2022-12-10_13:26:59.284572) 13:27:00.566453 tst osmo-nitb_10.42.42.2(pid=13583): stderr: | (launched: 2022-12-10_13:26:59.328346) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:27:00.705477 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=13583): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13583) [trial-2375↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13583)] [trial-2375↪nitb_ussd:trx-lms↪assert_extension.py:12] 13:27:00.713694 tst assert_extension.py:12: Test FAILED (3.1 sec) 13:27:00.720174 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13582): Terminating (SIGTERM) 13:27:00.929999 --- ParallelTerminationStrategy: PID 13582 died... 13:27:00.958886 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13582): Terminated: ok {rc=0} 13:27:01.051292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 ussd:trx-lms --------------------------------------------------------------------- 13:27:02.235323 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:27:02.239408 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 13:27:02.274799 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 13:27:02.300766 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 13:27:02.334804 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 13:27:02.368793 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 13:27:02.396002 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 13:27:02.923724 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2375 ussd:trx-lms assert_extension.py ---------------------------------------------- 13:27:02.929245 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:27:02.940077 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 13:27:02.989470 tst assert_extension.py: using LAC 28708 13:27:03.107613 tst assert_extension.py: using RAC 148 13:27:03.222396 tst assert_extension.py: using CellId 28708 13:27:03.335331 tst assert_extension.py: using BVCI 28709 13:27:03.441436 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:27:03.451828 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:27:03.462235 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:27:03.472644 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:27:03.483084 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:27:03.493649 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 13:27:03.609980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:04.091390 run create_hlr_db(pid=13587): Launched 13:27:04.218069 bus /sierra_2: Setting Powered False 13:27:05.280157 run create_hlr_db(pid=13587): Terminated: ok {rc=0} 13:27:05.698020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13589): Launched 13:27:05.989488 run osmo-hlr_10.42.42.2(pid=13590): Launched 13:27:06.101889 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:06.626956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13592): Launched 13:27:06.918313 run osmo-stp_10.42.42.5(pid=13593): Launched 13:27:07.029678 run osmo-msc_10.42.42.6: Starting osmo-msc 13:27:07.557038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13595): Launched 13:27:07.849595 run osmo-msc_10.42.42.6(pid=13596): Launched 13:27:08.014366 run osmo-stp_10.42.42.5(pid=13593): ERR: Terminated: ERROR {rc=1} [trial-2375↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13593)] 13:27:08.140176 run osmo-stp_10.42.42.5(pid=13593): stdout: | (launched: 2022-12-10_13:27:06.864618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:08.265535 run osmo-stp_10.42.42.5(pid=13593): stderr: | [0;m[38;5;43m20221210132707033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132707033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132707034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132707034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132707036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132707036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132707037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:08.388869 run osmo-stp_10.42.42.5(pid=13593): stdout: | (launched: 2022-12-10_13:27:06.864618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:08.505635 run osmo-stp_10.42.42.5(pid=13593): stderr: | [0;m[38;5;43m20221210132707033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132707033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132707034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132707034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132707036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132707036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132707037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:08.645869 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13593): Process ended prematurely: osmo-stp_10.42.42.5(pid=13593) [trial-2375↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13593)] [trial-2375↪ussd:trx-lms↪assert_extension.py:17] 13:27:08.654084 tst assert_extension.py:17: Test FAILED (5.7 sec) 13:27:08.680247 run osmo-hlr_10.42.42.2(pid=13590): ERR: Terminated: ERROR {rc=237} [trial-2375↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13590)] 13:27:08.727880 run osmo-hlr_10.42.42.2(pid=13590): stdout: | (launched: 2022-12-10_13:27:05.936176) 13:27:08.777196 run osmo-hlr_10.42.42.2(pid=13590): stderr: | [0;m[1;31m20221210132706110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132706110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132706110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132706110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132706110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132706110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132706122 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132706131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132706131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132706131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:08.845712 run osmo-msc_10.42.42.6(pid=13596): ERR: Terminated: ERROR {rc=2} [trial-2375↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13596)] 13:27:08.893030 run osmo-msc_10.42.42.6(pid=13596): stdout: | (launched: 2022-12-10_13:27:07.796062) 13:27:08.942230 run osmo-msc_10.42.42.6(pid=13596): stderr: | [0;m[38;5;43m20221210132708062 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132708062 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0521af9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132708063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132708063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132708063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132708064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132708065 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132708066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132708066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132708066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:27:08.991901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13589): Terminating (SIGTERM) 13:27:09.031288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13592): Terminating (SIGTERM) 13:27:09.070643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13595): Terminating (SIGTERM) 13:27:09.110210 --- ParallelTerminationStrategy: PID 13589 died... 13:27:09.128934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13589): Terminated: ok {rc=0} 13:27:09.173609 --- ParallelTerminationStrategy: PID 13592 died... 13:27:09.191945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13592): Terminated: ok {rc=0} 13:27:09.235457 --- ParallelTerminationStrategy: PID 13595 died... 13:27:09.253637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13595): Terminated: ok {rc=0} 13:27:09.336209 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:27:10.541215 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:27:10.547646 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:27:10.580567 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:27:10.606547 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:27:10.661701 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:27:10.694582 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:27:10.720993 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:27:11.267767 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:27:11.321133 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:27:11.332565 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:27:11.402746 tst mo_mt_call.py: using LAC 28709 13:27:11.528273 tst mo_mt_call.py: using RAC 149 13:27:11.652269 tst mo_mt_call.py: using CellId 28709 13:27:11.774862 tst mo_mt_call.py: using BVCI 28710 13:27:11.890255 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:27:11.901606 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:27:11.912656 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:27:11.923906 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:27:11.935136 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:27:11.946297 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:27:12.060520 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:27:12.175755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:12.639009 run create_hlr_db(pid=13601): Launched 13:27:12.753611 bus /sierra_2: Setting Powered False 13:27:13.812938 run create_hlr_db(pid=13601): Terminated: ok {rc=0} 13:27:14.246339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13603): Launched 13:27:14.563036 run osmo-hlr_10.42.42.2(pid=13604): Launched 13:27:14.685151 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:15.231041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13606): Launched 13:27:15.547345 run osmo-stp_10.42.42.5(pid=13607): Launched 13:27:15.669482 run osmo-msc_10.42.42.6: Starting osmo-msc 13:27:16.318056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13609): Launched 13:27:16.652717 run osmo-msc_10.42.42.6(pid=13610): Launched 13:27:17.082662 run osmo-stp_10.42.42.5(pid=13607): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13607)] 13:27:17.256577 run osmo-stp_10.42.42.5(pid=13607): stdout: | (launched: 2022-12-10_13:27:15.489247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:17.392171 run osmo-stp_10.42.42.5(pid=13607): stderr: | [0;m[38;5;43m20221210132715680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132715680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132715680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132715680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132715683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132715683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132715683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:17.524174 run osmo-stp_10.42.42.5(pid=13607): stdout: | (launched: 2022-12-10_13:27:15.489247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:17.650164 run osmo-stp_10.42.42.5(pid=13607): stderr: | [0;m[38;5;43m20221210132715680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132715680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132715680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132715680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132715683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132715683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132715683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:17.800547 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13607): Process ended prematurely: osmo-stp_10.42.42.5(pid=13607) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13607)] [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:27:17.810125 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:27:17.837610 run osmo-hlr_10.42.42.2(pid=13604): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13604)] 13:27:17.887000 run osmo-hlr_10.42.42.2(pid=13604): stdout: | (launched: 2022-12-10_13:27:14.505602) 13:27:17.938191 run osmo-hlr_10.42.42.2(pid=13604): stderr: | [0;m[1;31m20221210132714702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132714702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132714703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132714703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132714703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132714703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132714715 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132714724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132714724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132714724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:18.009419 run osmo-msc_10.42.42.6(pid=13610): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13610)] 13:27:18.058804 run osmo-msc_10.42.42.6(pid=13610): stdout: | (launched: 2022-12-10_13:27:16.587818) 13:27:18.109906 run osmo-msc_10.42.42.6(pid=13610): stderr: | [0;m[38;5;43m20221210132716952 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132716952 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f94027c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132716952 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132716953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132716953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132716953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132716955 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132716955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132716955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132716955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:27:18.161559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13603): Terminating (SIGTERM) 13:27:18.202765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13606): Terminating (SIGTERM) 13:27:18.244128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13609): Terminating (SIGTERM) 13:27:18.285628 --- ParallelTerminationStrategy: PID 13603 died... 13:27:18.305377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13603): Terminated: ok {rc=0} 13:27:18.350924 --- ParallelTerminationStrategy: PID 13606 died... 13:27:18.370324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13606): Terminated: ok {rc=0} 13:27:18.415620 --- ParallelTerminationStrategy: PID 13609 died... 13:27:18.434831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13609): Terminated: ok {rc=0} 13:27:18.522136 bus /sierra_3: Setting Powered False 13:27:19.621270 bus /sierra_3: Setting Powered False 13:27:20.735379 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:27:21.883250 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:27:21.895375 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:27:21.968251 tst mo_mt_call_osmux.py: using LAC 28710 13:27:22.086770 tst mo_mt_call_osmux.py: using RAC 150 13:27:22.202714 tst mo_mt_call_osmux.py: using CellId 28710 13:27:22.322442 tst mo_mt_call_osmux.py: using BVCI 28711 13:27:22.433462 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:27:22.444459 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:27:22.455455 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:27:22.466785 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:27:22.478217 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:27:22.489175 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:27:22.608209 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:27:22.729861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:23.222513 run create_hlr_db(pid=13612): Launched 13:27:23.351624 bus /sierra_2: Setting Powered False 13:27:24.413850 run create_hlr_db(pid=13612): Terminated: ok {rc=0} 13:27:24.838428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13614): Launched 13:27:25.136547 run osmo-hlr_10.42.42.2(pid=13615): Launched 13:27:25.250325 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:25.765463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13617): Launched 13:27:26.084040 run osmo-stp_10.42.42.5(pid=13618): Launched 13:27:26.205009 run osmo-msc_10.42.42.6: Starting osmo-msc 13:27:26.780169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13620): Launched 13:27:27.097591 run osmo-msc_10.42.42.6(pid=13621): Launched 13:27:27.275107 run osmo-stp_10.42.42.5(pid=13618): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13618)] 13:27:27.409356 run osmo-stp_10.42.42.5(pid=13618): stdout: | (launched: 2022-12-10_13:27:26.026411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:27.543976 run osmo-stp_10.42.42.5(pid=13618): stderr: | [0;m[38;5;43m20221210132726221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132726221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132726222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132726222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132726222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132726223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132726223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:27.678980 run osmo-stp_10.42.42.5(pid=13618): stdout: | (launched: 2022-12-10_13:27:26.026411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:27.805423 run osmo-stp_10.42.42.5(pid=13618): stderr: | [0;m[38;5;43m20221210132726221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132726221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132726222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132726222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132726222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132726223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132726223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:27.957227 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13618): Process ended prematurely: osmo-stp_10.42.42.5(pid=13618) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13618)] [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:27:27.966832 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:27:27.994373 run osmo-hlr_10.42.42.2(pid=13615): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13615)] 13:27:28.044213 run osmo-hlr_10.42.42.2(pid=13615): stdout: | (launched: 2022-12-10_13:27:25.082325) 13:27:28.096442 run osmo-hlr_10.42.42.2(pid=13615): stderr: | [0;m[1;31m20221210132725256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132725256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132725256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132725256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132725256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132725256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132725290 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132725300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132725300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132725300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:28.168623 run osmo-msc_10.42.42.6(pid=13621): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13621)] 13:27:28.218327 run osmo-msc_10.42.42.6(pid=13621): stdout: | (launched: 2022-12-10_13:27:27.039937) 13:27:28.269537 run osmo-msc_10.42.42.6(pid=13621): stderr: | [0;m[38;5;43m20221210132727366 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132727366 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f78f1180c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132727366 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132727366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132727366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132727367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132727368 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132727369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132727369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132727369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:27:28.321098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13614): Terminating (SIGTERM) 13:27:28.362443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13617): Terminating (SIGTERM) 13:27:28.403483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13620): Terminating (SIGTERM) 13:27:28.445104 --- ParallelTerminationStrategy: PID 13614 died... 13:27:28.464773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13614): Terminated: ok {rc=0} 13:27:28.510602 --- ParallelTerminationStrategy: PID 13617 died... 13:27:28.529809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13617): Terminated: ok {rc=0} 13:27:28.576286 --- ParallelTerminationStrategy: PID 13620 died... 13:27:28.595793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13620): Terminated: ok {rc=0} 13:27:28.682572 bus /sierra_3: Setting Powered False 13:27:29.778902 bus /sierra_3: Setting Powered False 13:27:30.901041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:27:32.191788 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:27:32.202388 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:27:32.251356 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:27:32.278937 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:27:32.330953 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:27:32.364809 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:27:32.391678 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:27:32.944310 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:27:32.995073 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:27:33.006415 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:27:33.074880 tst mo_mt_call.py: using LAC 28711 13:27:33.197928 tst mo_mt_call.py: using RAC 151 13:27:33.322699 tst mo_mt_call.py: using CellId 28711 13:27:33.446893 tst mo_mt_call.py: using BVCI 28712 13:27:33.562192 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:27:33.573920 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:27:33.585175 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:27:33.596249 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:27:33.607457 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:27:33.618574 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:27:33.736592 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:27:33.853459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:34.315009 run create_hlr_db(pid=13626): Launched 13:27:34.429693 bus /sierra_2: Setting Powered False 13:27:35.489293 run create_hlr_db(pid=13626): Terminated: ok {rc=0} 13:27:35.904199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13628): Launched 13:27:36.204714 run osmo-hlr_10.42.42.2(pid=13634): Launched 13:27:36.319616 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:36.836713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13636): Launched 13:27:37.134180 run osmo-stp_10.42.42.5(pid=13637): Launched 13:27:37.248569 run osmo-msc_10.42.42.6: Starting osmo-msc 13:27:37.788377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13639): Launched 13:27:38.085546 run osmo-msc_10.42.42.6(pid=13640): Launched 13:27:38.253538 run osmo-stp_10.42.42.5(pid=13637): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13637)] 13:27:38.381690 run osmo-stp_10.42.42.5(pid=13637): stdout: | (launched: 2022-12-10_13:27:37.079454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:38.509242 run osmo-stp_10.42.42.5(pid=13637): stderr: | [0;m[38;5;43m20221210132737249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132737249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132737249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132737249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132737250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132737250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132737250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:38.633864 run osmo-stp_10.42.42.5(pid=13637): stdout: | (launched: 2022-12-10_13:27:37.079454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:38.752622 run osmo-stp_10.42.42.5(pid=13637): stderr: | [0;m[38;5;43m20221210132737249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132737249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132737249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132737249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132737250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132737250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132737250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:38.894729 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13637): Process ended prematurely: osmo-stp_10.42.42.5(pid=13637) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13637)] [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:27:38.903499 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 13:27:38.929955 run osmo-hlr_10.42.42.2(pid=13634): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13634)] 13:27:38.977669 run osmo-hlr_10.42.42.2(pid=13634): stdout: | (launched: 2022-12-10_13:27:36.150422) 13:27:39.026786 run osmo-hlr_10.42.42.2(pid=13634): stderr: | [0;m[1;31m20221210132736323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132736323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132736324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132736324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132736324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132736324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132736336 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132736345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132736345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132736345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:39.095437 run osmo-msc_10.42.42.6(pid=13640): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13640)] 13:27:39.142851 run osmo-msc_10.42.42.6(pid=13640): stdout: | (launched: 2022-12-10_13:27:38.030849) 13:27:39.191669 run osmo-msc_10.42.42.6(pid=13640): stderr: | [0;m[38;5;43m20221210132738302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132738302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2cad347c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132738302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132738302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132738302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132738302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132738305 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132738305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132738305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132738305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:27:39.241098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13628): Terminating (SIGTERM) 13:27:39.280213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13636): Terminating (SIGTERM) 13:27:39.319444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13639): Terminating (SIGTERM) 13:27:39.359123 --- ParallelTerminationStrategy: PID 13628 died... 13:27:39.378002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13628): Terminated: ok {rc=0} 13:27:39.421741 --- ParallelTerminationStrategy: PID 13636 died... 13:27:39.439972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13636): Terminated: ok {rc=0} 13:27:39.483495 --- ParallelTerminationStrategy: PID 13639 died... 13:27:39.501662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13639): Terminated: ok {rc=0} 13:27:39.584937 bus /sierra_3: Setting Powered False 13:27:40.682434 bus /sierra_3: Setting Powered False 13:27:41.800264 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:27:42.944025 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:27:42.955870 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:27:43.022813 tst mo_mt_call_osmux.py: using LAC 28712 13:27:43.140535 tst mo_mt_call_osmux.py: using RAC 152 13:27:43.256709 tst mo_mt_call_osmux.py: using CellId 28712 13:27:43.372538 tst mo_mt_call_osmux.py: using BVCI 28713 13:27:43.481700 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:27:43.492522 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:27:43.503214 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:27:43.514231 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:27:43.525268 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:27:43.536107 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:27:43.650636 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:27:43.768663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:44.261305 run create_hlr_db(pid=13642): Launched 13:27:44.390735 bus /sierra_2: Setting Powered False 13:27:45.454191 run create_hlr_db(pid=13642): Terminated: ok {rc=0} 13:27:45.901739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13644): Launched 13:27:46.225975 run osmo-hlr_10.42.42.2(pid=13645): Launched 13:27:46.459344 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:47.172292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13647): Launched 13:27:47.499099 run osmo-stp_10.42.42.5(pid=13648): Launched 13:27:47.621278 run osmo-msc_10.42.42.6: Starting osmo-msc 13:27:48.197166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13650): Launched 13:27:48.514846 run osmo-msc_10.42.42.6(pid=13651): Launched 13:27:48.693237 run osmo-stp_10.42.42.5(pid=13648): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13648)] 13:27:48.827121 run osmo-stp_10.42.42.5(pid=13648): stdout: | (launched: 2022-12-10_13:27:47.440742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:48.961242 run osmo-stp_10.42.42.5(pid=13648): stderr: | [0;m[38;5;43m20221210132747633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132747633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132747634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132747634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132747636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132747636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132747636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:49.095335 run osmo-stp_10.42.42.5(pid=13648): stdout: | (launched: 2022-12-10_13:27:47.440742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:49.221301 run osmo-stp_10.42.42.5(pid=13648): stderr: | [0;m[38;5;43m20221210132747633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132747633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132747634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132747634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132747636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132747636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132747636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:49.371965 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13648): Process ended prematurely: osmo-stp_10.42.42.5(pid=13648) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13648)] [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:27:49.381304 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:27:49.408855 run osmo-hlr_10.42.42.2(pid=13645): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13645)] 13:27:49.459189 run osmo-hlr_10.42.42.2(pid=13645): stdout: | (launched: 2022-12-10_13:27:46.156672) 13:27:49.510821 run osmo-hlr_10.42.42.2(pid=13645): stderr: | [0;m[1;31m20221210132746502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132746502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132746502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132746502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132746502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132746502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132746519 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132746527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132746528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132746528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:49.582967 run osmo-msc_10.42.42.6(pid=13651): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13651)] 13:27:49.633115 run osmo-msc_10.42.42.6(pid=13651): stdout: | (launched: 2022-12-10_13:27:48.456877) 13:27:49.684335 run osmo-msc_10.42.42.6(pid=13651): stderr: | [0;m[38;5;43m20221210132748779 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132748779 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9a50ac0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132748779 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132748780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132748780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132748780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132748782 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132748782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132748782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132748782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:27:49.736036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13644): Terminating (SIGTERM) 13:27:49.777906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13647): Terminating (SIGTERM) 13:27:49.819601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13650): Terminating (SIGTERM) 13:27:49.861437 --- ParallelTerminationStrategy: PID 13644 died... 13:27:49.881317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13644): Terminated: ok {rc=0} 13:27:49.927353 --- ParallelTerminationStrategy: PID 13647 died... 13:27:49.946802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13647): Terminated: ok {rc=0} 13:27:49.993198 --- ParallelTerminationStrategy: PID 13650 died... 13:27:50.012420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13650): Terminated: ok {rc=0} 13:27:50.099483 bus /sierra_3: Setting Powered False 13:27:51.198794 bus /sierra_3: Setting Powered False 13:27:52.315293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:27:53.566686 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:27:53.573766 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:27:53.607521 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:27:53.634681 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:27:53.687788 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:27:53.721220 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:27:53.748107 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:27:54.297798 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:27:54.348615 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:27:54.360041 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:27:54.429400 tst mo_mt_call.py: using LAC 28713 13:27:54.557237 tst mo_mt_call.py: using RAC 153 13:27:54.682231 tst mo_mt_call.py: using CellId 28713 13:27:54.807842 tst mo_mt_call.py: using BVCI 28714 13:27:54.923432 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:27:54.934736 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:27:54.946071 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:27:54.957195 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:27:54.968262 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:27:54.979679 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:27:55.093735 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:27:55.214306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:55.708342 run create_hlr_db(pid=13657): Launched 13:27:55.836354 bus /sierra_2: Setting Powered False 13:27:56.899439 run create_hlr_db(pid=13657): Terminated: ok {rc=0} 13:27:57.326103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13659): Launched 13:27:57.626326 run osmo-hlr_10.42.42.2(pid=13660): Launched 13:27:57.740242 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:58.253198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13662): Launched 13:27:58.550608 run osmo-stp_10.42.42.5(pid=13663): Launched 13:27:58.664042 run osmo-msc_10.42.42.6: Starting osmo-msc 13:27:59.202715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13665): Launched 13:27:59.498978 run osmo-msc_10.42.42.6(pid=13666): Launched 13:27:59.667020 run osmo-stp_10.42.42.5(pid=13663): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13663)] 13:27:59.794167 run osmo-stp_10.42.42.5(pid=13663): stdout: | (launched: 2022-12-10_13:27:58.495735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:59.921390 run osmo-stp_10.42.42.5(pid=13663): stderr: | [0;m[38;5;43m20221210132758665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132758665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132758665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132758666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132758668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132758668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132758668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:00.045759 run osmo-stp_10.42.42.5(pid=13663): stdout: | (launched: 2022-12-10_13:27:58.495735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:00.164102 run osmo-stp_10.42.42.5(pid=13663): stderr: | [0;m[38;5;43m20221210132758665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132758665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132758665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132758666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132758668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132758668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132758668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:00.305885 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13663): Process ended prematurely: osmo-stp_10.42.42.5(pid=13663) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13663)] [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:28:00.314638 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:28:00.340769 run osmo-hlr_10.42.42.2(pid=13660): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13660)] 13:28:00.388176 run osmo-hlr_10.42.42.2(pid=13660): stdout: | (launched: 2022-12-10_13:27:57.571305) 13:28:00.437191 run osmo-hlr_10.42.42.2(pid=13660): stderr: | [0;m[1;31m20221210132757746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132757746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132757746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132757746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132757746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132757747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132757759 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132757770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132757770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132757770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:00.505447 run osmo-msc_10.42.42.6(pid=13666): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13666)] 13:28:00.552853 run osmo-msc_10.42.42.6(pid=13666): stdout: | (launched: 2022-12-10_13:27:59.444785) 13:28:00.601665 run osmo-msc_10.42.42.6(pid=13666): stderr: | [0;m[38;5;43m20221210132759717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132759717 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1987c68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132759717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132759717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132759717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132759718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132759721 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132759722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132759722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132759722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:28:00.651045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13659): Terminating (SIGTERM) 13:28:00.690311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13662): Terminating (SIGTERM) 13:28:00.729418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13665): Terminating (SIGTERM) 13:28:00.769348 --- ParallelTerminationStrategy: PID 13659 died... 13:28:00.788008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13659): Terminated: ok {rc=0} 13:28:00.837901 --- ParallelTerminationStrategy: PID 13662 died... 13:28:00.858472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13662): Terminated: ok {rc=0} 13:28:00.913922 --- ParallelTerminationStrategy: PID 13665 died... 13:28:00.933080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13665): Terminated: ok {rc=0} 13:28:01.033438 bus /sierra_3: Setting Powered False 13:28:02.141145 bus /sierra_3: Setting Powered False 13:28:03.266301 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:28:04.414349 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:28:04.426482 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:28:04.497019 tst mo_mt_call_osmux.py: using LAC 28714 13:28:04.627524 tst mo_mt_call_osmux.py: using RAC 154 13:28:04.751930 tst mo_mt_call_osmux.py: using CellId 28714 13:28:04.870517 tst mo_mt_call_osmux.py: using BVCI 28715 13:28:04.981437 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:28:04.992349 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:28:05.003374 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:28:05.014521 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:28:05.025731 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:28:05.036789 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:28:05.155083 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:28:05.274885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:05.769181 run create_hlr_db(pid=13668): Launched 13:28:05.898555 bus /sierra_2: Setting Powered False 13:28:06.962453 run create_hlr_db(pid=13668): Terminated: ok {rc=0} 13:28:07.389107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13670): Launched 13:28:07.689135 run osmo-hlr_10.42.42.2(pid=13671): Launched 13:28:07.803699 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:08.328832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13673): Launched 13:28:08.626247 run osmo-stp_10.42.42.5(pid=13674): Launched 13:28:08.740316 run osmo-msc_10.42.42.6: Starting osmo-msc 13:28:09.281170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13676): Launched 13:28:09.578942 run osmo-msc_10.42.42.6(pid=13677): Launched 13:28:09.746374 run osmo-stp_10.42.42.5(pid=13674): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13674)] 13:28:09.872558 run osmo-stp_10.42.42.5(pid=13674): stdout: | (launched: 2022-12-10_13:28:08.571673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:09.998824 run osmo-stp_10.42.42.5(pid=13674): stderr: | [0;m[38;5;43m20221210132808741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132808741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132808741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132808742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132808742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132808742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132808742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:10.122969 run osmo-stp_10.42.42.5(pid=13674): stdout: | (launched: 2022-12-10_13:28:08.571673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:10.240934 run osmo-stp_10.42.42.5(pid=13674): stderr: | [0;m[38;5;43m20221210132808741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132808741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132808741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132808742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132808742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132808742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132808742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:10.382754 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13674): Process ended prematurely: osmo-stp_10.42.42.5(pid=13674) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13674)] [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:28:10.391351 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:28:10.417652 run osmo-hlr_10.42.42.2(pid=13671): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13671)] 13:28:10.465164 run osmo-hlr_10.42.42.2(pid=13671): stdout: | (launched: 2022-12-10_13:28:07.634333) 13:28:10.514127 run osmo-hlr_10.42.42.2(pid=13671): stderr: | [0;m[1;31m20221210132807812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132807812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132807812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132807812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132807812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132807812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132807824 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132807834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132807835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132807835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:10.582326 run osmo-msc_10.42.42.6(pid=13677): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13677)] 13:28:10.629714 run osmo-msc_10.42.42.6(pid=13677): stdout: | (launched: 2022-12-10_13:28:09.524048) 13:28:10.678600 run osmo-msc_10.42.42.6(pid=13677): stderr: | [0;m[38;5;43m20221210132809794 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132809794 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efd7254ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132809795 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132809795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132809795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132809795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132809797 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132809797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132809797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132809797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:28:10.727872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13670): Terminating (SIGTERM) 13:28:10.766938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13673): Terminating (SIGTERM) 13:28:10.805945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13676): Terminating (SIGTERM) 13:28:10.845348 --- ParallelTerminationStrategy: PID 13670 died... 13:28:10.863909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13670): Terminated: ok {rc=0} 13:28:10.907605 --- ParallelTerminationStrategy: PID 13673 died... 13:28:10.925786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13673): Terminated: ok {rc=0} 13:28:10.969037 --- ParallelTerminationStrategy: PID 13676 died... 13:28:10.987215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13676): Terminated: ok {rc=0} 13:28:11.071411 bus /sierra_3: Setting Powered False 13:28:12.168667 bus /sierra_3: Setting Powered False 13:28:13.282355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:28:14.528284 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:28:14.536218 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:28:14.570261 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:28:14.597952 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:28:14.651262 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:28:14.685216 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:28:14.712644 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:28:15.261605 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:28:15.312676 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:28:15.324253 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:28:15.394346 tst mo_mt_call.py: using LAC 28715 13:28:15.520570 tst mo_mt_call.py: using RAC 155 13:28:15.645771 tst mo_mt_call.py: using CellId 28715 13:28:15.770510 tst mo_mt_call.py: using BVCI 28716 13:28:15.890484 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:28:15.910784 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:28:15.931087 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:28:15.947123 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:28:15.960130 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:28:15.973232 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:28:16.095195 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:28:16.242984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:16.740754 run create_hlr_db(pid=13682): Launched 13:28:16.894131 bus /sierra_2: Setting Powered False 13:28:17.953492 run create_hlr_db(pid=13682): Terminated: ok {rc=0} 13:28:18.389385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13684): Launched 13:28:18.707785 run osmo-hlr_10.42.42.2(pid=13685): Launched 13:28:18.829288 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:19.383240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13687): Launched 13:28:19.701086 run osmo-stp_10.42.42.5(pid=13688): Launched 13:28:19.823150 run osmo-msc_10.42.42.6: Starting osmo-msc 13:28:20.398088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13690): Launched 13:28:20.715444 run osmo-msc_10.42.42.6(pid=13691): Launched 13:28:20.891929 run osmo-stp_10.42.42.5(pid=13688): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13688)] 13:28:21.025617 run osmo-stp_10.42.42.5(pid=13688): stdout: | (launched: 2022-12-10_13:28:19.643024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:21.159573 run osmo-stp_10.42.42.5(pid=13688): stderr: | [0;m[38;5;43m20221210132819835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132819835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132819835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132819835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132819836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132819836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132819836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:21.293203 run osmo-stp_10.42.42.5(pid=13688): stdout: | (launched: 2022-12-10_13:28:19.643024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:21.419595 run osmo-stp_10.42.42.5(pid=13688): stderr: | [0;m[38;5;43m20221210132819835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132819835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132819835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132819835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132819836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132819836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132819836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:21.570741 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13688): Process ended prematurely: osmo-stp_10.42.42.5(pid=13688) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13688)] [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:28:21.580146 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:28:21.608361 run osmo-hlr_10.42.42.2(pid=13685): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13685)] 13:28:21.658559 run osmo-hlr_10.42.42.2(pid=13685): stdout: | (launched: 2022-12-10_13:28:18.649979) 13:28:21.710596 run osmo-hlr_10.42.42.2(pid=13685): stderr: | [0;m[1;31m20221210132818848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132818848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132818848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132818848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132818848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132818848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132818860 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132818869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132818869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132818869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:21.782858 run osmo-msc_10.42.42.6(pid=13691): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13691)] 13:28:21.832734 run osmo-msc_10.42.42.6(pid=13691): stdout: | (launched: 2022-12-10_13:28:20.657716) 13:28:21.884478 run osmo-msc_10.42.42.6(pid=13691): stderr: | [0;m[38;5;43m20221210132820982 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132820982 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb964d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132820982 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132820982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132820982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132820982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132820984 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132820984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132820984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132820985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:28:21.936563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13684): Terminating (SIGTERM) 13:28:21.978078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13687): Terminating (SIGTERM) 13:28:22.019683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13690): Terminating (SIGTERM) 13:28:22.061493 --- ParallelTerminationStrategy: PID 13684 died... 13:28:22.081255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13684): Terminated: ok {rc=0} 13:28:22.127449 --- ParallelTerminationStrategy: PID 13687 died... 13:28:22.146875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13687): Terminated: ok {rc=0} 13:28:22.192897 --- ParallelTerminationStrategy: PID 13690 died... 13:28:22.212592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13690): Terminated: ok {rc=0} 13:28:22.299400 bus /sierra_3: Setting Powered False 13:28:23.394859 bus /sierra_3: Setting Powered False 13:28:24.509090 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:28:25.652575 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:28:25.664276 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:28:25.733783 tst mo_mt_call_osmux.py: using LAC 28716 13:28:25.860624 tst mo_mt_call_osmux.py: using RAC 156 13:28:25.985683 tst mo_mt_call_osmux.py: using CellId 28716 13:28:26.111342 tst mo_mt_call_osmux.py: using BVCI 28717 13:28:26.228744 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:28:26.240384 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:28:26.251880 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:28:26.263511 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:28:26.275081 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:28:26.286573 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:28:26.405351 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:28:26.523524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:27.020239 run create_hlr_db(pid=13693): Launched 13:28:27.149148 bus /sierra_2: Setting Powered False 13:28:28.213088 run create_hlr_db(pid=13693): Terminated: ok {rc=0} 13:28:28.657021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13695): Launched 13:28:28.975790 run osmo-hlr_10.42.42.2(pid=13696): Launched 13:28:29.097780 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:29.651391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13698): Launched 13:28:29.970272 run osmo-stp_10.42.42.5(pid=13699): Launched 13:28:30.091873 run osmo-msc_10.42.42.6: Starting osmo-msc 13:28:30.670192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13701): Launched 13:28:31.025677 run osmo-msc_10.42.42.6(pid=13702): Launched 13:28:31.337732 run osmo-stp_10.42.42.5(pid=13699): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13699)] 13:28:31.563008 run osmo-stp_10.42.42.5(pid=13699): stdout: | (launched: 2022-12-10_13:28:29.912276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:31.710366 run osmo-stp_10.42.42.5(pid=13699): stderr: | [0;m[38;5;43m20221210132830102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132830102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132830103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132830103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132830104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132830104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132830104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:31.910596 run osmo-stp_10.42.42.5(pid=13699): stdout: | (launched: 2022-12-10_13:28:29.912276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:32.065749 run osmo-stp_10.42.42.5(pid=13699): stderr: | [0;m[38;5;43m20221210132830102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132830102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132830103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132830103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132830104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132830104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132830104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:32.235138 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13699): Process ended prematurely: osmo-stp_10.42.42.5(pid=13699) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13699)] [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:28:32.245452 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 13:28:32.276032 run osmo-hlr_10.42.42.2(pid=13696): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13696)] 13:28:32.328353 run osmo-hlr_10.42.42.2(pid=13696): stdout: | (launched: 2022-12-10_13:28:28.917776) 13:28:32.381951 run osmo-hlr_10.42.42.2(pid=13696): stderr: | [0;m[1;31m20221210132829117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132829117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132829117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132829117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132829117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132829117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132829130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132829139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132829139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132829139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:32.455681 run osmo-msc_10.42.42.6(pid=13702): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13702)] 13:28:32.506828 run osmo-msc_10.42.42.6(pid=13702): stdout: | (launched: 2022-12-10_13:28:30.953086) 13:28:32.559616 run osmo-msc_10.42.42.6(pid=13702): stderr: | [0;m[38;5;43m20221210132831480 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132831480 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4910269c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132831480 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132831480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132831480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132831480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132831482 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132831483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132831483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132831483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:28:32.612920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13695): Terminating (SIGTERM) 13:28:32.655266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13698): Terminating (SIGTERM) 13:28:32.697656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13701): Terminating (SIGTERM) 13:28:32.740633 --- ParallelTerminationStrategy: PID 13695 died... 13:28:32.760665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13695): Terminated: ok {rc=0} 13:28:32.808061 --- ParallelTerminationStrategy: PID 13698 died... 13:28:32.827813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13698): Terminated: ok {rc=0} 13:28:32.874958 --- ParallelTerminationStrategy: PID 13701 died... 13:28:32.894699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13701): Terminated: ok {rc=0} 13:28:32.983068 bus /sierra_3: Setting Powered False 13:28:34.082316 bus /sierra_3: Setting Powered False 13:28:35.200578 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:28:36.450166 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:28:36.458404 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:28:36.491675 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:28:36.518496 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:28:36.570612 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:28:36.603896 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:28:36.630550 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:28:37.178197 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:28:37.227484 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:28:37.238605 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:28:37.307142 tst mo_mt_call.py: using LAC 28717 13:28:37.426765 tst mo_mt_call.py: using RAC 157 13:28:37.544471 tst mo_mt_call.py: using CellId 28717 13:28:37.663322 tst mo_mt_call.py: using BVCI 28718 13:28:37.780088 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:28:37.791426 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:28:37.802766 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:28:37.813925 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:28:37.825120 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:28:37.836415 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:28:37.951102 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:28:38.067175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:38.530757 run create_hlr_db(pid=13707): Launched 13:28:38.646538 bus /sierra_2: Setting Powered False 13:28:39.705159 run create_hlr_db(pid=13707): Terminated: ok {rc=0} 13:28:40.122244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13709): Launched 13:28:40.420241 run osmo-hlr_10.42.42.2(pid=13710): Launched 13:28:40.535025 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:41.048448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13712): Launched 13:28:41.345327 run osmo-stp_10.42.42.5(pid=13713): Launched 13:28:41.458996 run osmo-msc_10.42.42.6: Starting osmo-msc 13:28:41.997478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13715): Launched 13:28:42.296645 run osmo-msc_10.42.42.6(pid=13716): Launched 13:28:42.463228 run osmo-stp_10.42.42.5(pid=13713): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13713)] 13:28:42.590741 run osmo-stp_10.42.42.5(pid=13713): stdout: | (launched: 2022-12-10_13:28:41.291184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:42.717441 run osmo-stp_10.42.42.5(pid=13713): stderr: | [0;m[38;5;43m20221210132841460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132841460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132841460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132841461 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132841463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132841463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132841463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:42.841349 run osmo-stp_10.42.42.5(pid=13713): stdout: | (launched: 2022-12-10_13:28:41.291184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:42.959615 run osmo-stp_10.42.42.5(pid=13713): stderr: | [0;m[38;5;43m20221210132841460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132841460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132841460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132841461 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132841463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132841463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132841463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:43.100871 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13713): Process ended prematurely: osmo-stp_10.42.42.5(pid=13713) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13713)] [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:28:43.109823 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 13:28:43.135988 run osmo-hlr_10.42.42.2(pid=13710): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13710)] 13:28:43.183112 run osmo-hlr_10.42.42.2(pid=13710): stdout: | (launched: 2022-12-10_13:28:40.365763) 13:28:43.232112 run osmo-hlr_10.42.42.2(pid=13710): stderr: | [0;m[1;31m20221210132840542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132840542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132840542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132840542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132840542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132840542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132840558 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132840567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132840568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132840568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:43.299889 run osmo-msc_10.42.42.6(pid=13716): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13716)] 13:28:43.347011 run osmo-msc_10.42.42.6(pid=13716): stdout: | (launched: 2022-12-10_13:28:42.241923) 13:28:43.395617 run osmo-msc_10.42.42.6(pid=13716): stderr: | [0;m[38;5;43m20221210132842515 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132842515 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0d23089c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132842515 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132842515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132842516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132842516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132842518 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132842519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132842519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132842519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:28:43.444983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13709): Terminating (SIGTERM) 13:28:43.483817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13712): Terminating (SIGTERM) 13:28:43.522851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13715): Terminating (SIGTERM) 13:28:43.562508 --- ParallelTerminationStrategy: PID 13709 died... 13:28:43.581600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13709): Terminated: ok {rc=0} 13:28:43.625152 --- ParallelTerminationStrategy: PID 13712 died... 13:28:43.643394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13712): Terminated: ok {rc=0} 13:28:43.686729 --- ParallelTerminationStrategy: PID 13715 died... 13:28:43.705070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13715): Terminated: ok {rc=0} 13:28:43.789211 bus /sierra_3: Setting Powered False 13:28:44.885203 bus /sierra_3: Setting Powered False 13:28:46.002627 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:28:47.149142 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:28:47.161589 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:28:47.232319 tst mo_mt_call_osmux.py: using LAC 28718 13:28:47.357808 tst mo_mt_call_osmux.py: using RAC 158 13:28:47.482792 tst mo_mt_call_osmux.py: using CellId 28718 13:28:47.611428 tst mo_mt_call_osmux.py: using BVCI 28719 13:28:47.723118 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:28:47.734302 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:28:47.745148 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:28:47.756507 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:28:47.768584 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:28:47.780227 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:28:47.899251 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:28:48.020354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:48.511618 run create_hlr_db(pid=13718): Launched 13:28:48.641425 bus /sierra_2: Setting Powered False 13:28:49.704119 run create_hlr_db(pid=13718): Terminated: ok {rc=0} 13:28:50.127786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13720): Launched 13:28:50.424634 run osmo-hlr_10.42.42.2(pid=13721): Launched 13:28:50.538315 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:51.063107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13723): Launched 13:28:51.361356 run osmo-stp_10.42.42.5(pid=13724): Launched 13:28:51.474692 run osmo-msc_10.42.42.6: Starting osmo-msc 13:28:52.014655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13726): Launched 13:28:52.311653 run osmo-msc_10.42.42.6(pid=13727): Launched 13:28:52.479423 run osmo-stp_10.42.42.5(pid=13724): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13724)] 13:28:52.606636 run osmo-stp_10.42.42.5(pid=13724): stdout: | (launched: 2022-12-10_13:28:51.305854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:52.733599 run osmo-stp_10.42.42.5(pid=13724): stderr: | [0;m[38;5;43m20221210132851474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132851475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132851475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132851475 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132851477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132851478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132851478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:52.858107 run osmo-stp_10.42.42.5(pid=13724): stdout: | (launched: 2022-12-10_13:28:51.305854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:52.976337 run osmo-stp_10.42.42.5(pid=13724): stderr: | [0;m[38;5;43m20221210132851474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132851475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132851475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132851475 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132851477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132851478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132851478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:53.118178 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13724): Process ended prematurely: osmo-stp_10.42.42.5(pid=13724) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13724)] [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:28:53.126938 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:28:53.153290 run osmo-hlr_10.42.42.2(pid=13721): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13721)] 13:28:53.200884 run osmo-hlr_10.42.42.2(pid=13721): stdout: | (launched: 2022-12-10_13:28:50.370676) 13:28:53.249779 run osmo-hlr_10.42.42.2(pid=13721): stderr: | [0;m[1;31m20221210132850545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132850545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132850545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132850545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132850545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132850545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132850558 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132850567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132850568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132850568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:53.317822 run osmo-msc_10.42.42.6(pid=13727): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13727)] 13:28:53.365125 run osmo-msc_10.42.42.6(pid=13727): stdout: | (launched: 2022-12-10_13:28:52.257384) 13:28:53.413993 run osmo-msc_10.42.42.6(pid=13727): stderr: | [0;m[38;5;43m20221210132852528 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132852528 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f73e7592c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132852528 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132852528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132852528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132852529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132852530 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132852531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132852531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132852531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:28:53.463459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13720): Terminating (SIGTERM) 13:28:53.502668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13723): Terminating (SIGTERM) 13:28:53.541858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13726): Terminating (SIGTERM) 13:28:53.581216 --- ParallelTerminationStrategy: PID 13720 died... 13:28:53.600167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13720): Terminated: ok {rc=0} 13:28:53.643920 --- ParallelTerminationStrategy: PID 13723 died... 13:28:53.662227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13723): Terminated: ok {rc=0} 13:28:53.705902 --- ParallelTerminationStrategy: PID 13726 died... 13:28:53.724055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13726): Terminated: ok {rc=0} 13:28:53.806763 bus /sierra_3: Setting Powered False 13:28:54.904050 bus /sierra_3: Setting Powered False 13:28:56.017368 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:28:57.264058 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:28:57.271968 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:28:57.305762 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:28:57.333178 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:28:57.386010 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:28:57.419340 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:28:57.446164 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:28:57.997483 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:28:58.048501 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:28:58.060070 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:28:58.130502 tst mo_mt_call.py: using LAC 28719 13:28:58.256717 tst mo_mt_call.py: using RAC 159 13:28:58.381144 tst mo_mt_call.py: using CellId 28719 13:28:58.505794 tst mo_mt_call.py: using BVCI 28720 13:28:58.622738 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:28:58.634210 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:28:58.645430 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:28:58.656577 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:28:58.668009 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:28:58.679145 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:28:58.794684 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:28:58.913225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:59.405685 run create_hlr_db(pid=13732): Launched 13:28:59.535252 bus /sierra_2: Setting Powered False 13:29:00.599403 run create_hlr_db(pid=13732): Terminated: ok {rc=0} 13:29:01.069718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13734): Launched 13:29:01.394698 run osmo-hlr_10.42.42.2(pid=13735): Launched 13:29:01.728781 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:02.358542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13737): Launched 13:29:02.657299 run osmo-stp_10.42.42.5(pid=13738): Launched 13:29:02.772134 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:03.310855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13740): Launched 13:29:03.609042 run osmo-msc_10.42.42.6(pid=13741): Launched 13:29:03.777334 run osmo-stp_10.42.42.5(pid=13738): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13738)] 13:29:03.904599 run osmo-stp_10.42.42.5(pid=13738): stdout: | (launched: 2022-12-10_13:29:02.602712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:04.031646 run osmo-stp_10.42.42.5(pid=13738): stderr: | [0;m[38;5;43m20221210132902771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132902771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132902772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132902772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132902773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132902773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132902773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:04.156737 run osmo-stp_10.42.42.5(pid=13738): stdout: | (launched: 2022-12-10_13:29:02.602712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:04.275228 run osmo-stp_10.42.42.5(pid=13738): stderr: | [0;m[38;5;43m20221210132902771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132902771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132902772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132902772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132902773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132902773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132902773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:04.417413 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13738): Process ended prematurely: osmo-stp_10.42.42.5(pid=13738) [trial-2375↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13738)] [trial-2375↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:29:04.426351 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:29:04.452846 run osmo-hlr_10.42.42.2(pid=13735): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13735)] 13:29:04.500706 run osmo-hlr_10.42.42.2(pid=13735): stdout: | (launched: 2022-12-10_13:29:01.334317) 13:29:04.549771 run osmo-hlr_10.42.42.2(pid=13735): stderr: | [0;m[1;31m20221210132901660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132901660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132901660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132901660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132901660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132901660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132901674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132901698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132901699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132901699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:04.618506 run osmo-msc_10.42.42.6(pid=13741): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13741)] 13:29:04.665992 run osmo-msc_10.42.42.6(pid=13741): stdout: | (launched: 2022-12-10_13:29:03.554424) 13:29:04.714865 run osmo-msc_10.42.42.6(pid=13741): stderr: | [0;m[38;5;43m20221210132903824 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132903824 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f83048c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132903824 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132903824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132903824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132903825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132903826 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132903827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132903827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132903827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:04.764139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13734): Terminating (SIGTERM) 13:29:04.803241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13737): Terminating (SIGTERM) 13:29:04.842796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13740): Terminating (SIGTERM) 13:29:04.882473 --- ParallelTerminationStrategy: PID 13734 died... 13:29:04.901323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13734): Terminated: ok {rc=0} 13:29:04.945277 --- ParallelTerminationStrategy: PID 13737 died... 13:29:04.963532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13737): Terminated: ok {rc=0} 13:29:05.007275 --- ParallelTerminationStrategy: PID 13740 died... 13:29:05.025759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13740): Terminated: ok {rc=0} 13:29:05.109896 bus /sierra_3: Setting Powered False 13:29:06.207672 bus /sierra_3: Setting Powered False 13:29:07.321920 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:29:08.466574 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:29:08.478369 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:29:08.547645 tst mo_mt_call_osmux.py: using LAC 28720 13:29:08.666192 tst mo_mt_call_osmux.py: using RAC 160 13:29:08.783950 tst mo_mt_call_osmux.py: using CellId 28720 13:29:08.902149 tst mo_mt_call_osmux.py: using BVCI 28721 13:29:09.011420 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:29:09.022559 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:29:09.033454 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:29:09.044599 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:29:09.055769 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:29:09.066822 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:29:09.180231 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:29:09.299825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:09.794870 run create_hlr_db(pid=13743): Launched 13:29:09.924384 bus /sierra_2: Setting Powered False 13:29:10.988143 run create_hlr_db(pid=13743): Terminated: ok {rc=0} 13:29:11.430388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13745): Launched 13:29:11.748282 run osmo-hlr_10.42.42.2(pid=13746): Launched 13:29:11.869641 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:12.418787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13748): Launched 13:29:12.735972 run osmo-stp_10.42.42.5(pid=13749): Launched 13:29:12.857103 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:13.437445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13751): Launched 13:29:13.756165 run osmo-msc_10.42.42.6(pid=13752): Launched 13:29:13.933655 run osmo-stp_10.42.42.5(pid=13749): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13749)] 13:29:14.067894 run osmo-stp_10.42.42.5(pid=13749): stdout: | (launched: 2022-12-10_13:29:12.678121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:14.203577 run osmo-stp_10.42.42.5(pid=13749): stderr: | [0;m[38;5;43m20221210132912871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132912872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132912872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132912872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132912873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132912873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132912873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:14.337841 run osmo-stp_10.42.42.5(pid=13749): stdout: | (launched: 2022-12-10_13:29:12.678121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:14.464141 run osmo-stp_10.42.42.5(pid=13749): stderr: | [0;m[38;5;43m20221210132912871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132912872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132912872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132912872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132912873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132912873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132912873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:14.615694 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13749): Process ended prematurely: osmo-stp_10.42.42.5(pid=13749) [trial-2375↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13749)] [trial-2375↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:29:14.625689 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:29:14.653401 run osmo-hlr_10.42.42.2(pid=13746): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13746)] 13:29:14.703193 run osmo-hlr_10.42.42.2(pid=13746): stdout: | (launched: 2022-12-10_13:29:11.690417) 13:29:14.754322 run osmo-hlr_10.42.42.2(pid=13746): stderr: | [0;m[1;31m20221210132911888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132911889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132911889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132911889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132911889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132911889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132911942 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132911951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132911951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132911951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:14.826003 run osmo-msc_10.42.42.6(pid=13752): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13752)] 13:29:14.875496 run osmo-msc_10.42.42.6(pid=13752): stdout: | (launched: 2022-12-10_13:29:13.698135) 13:29:14.926486 run osmo-msc_10.42.42.6(pid=13752): stderr: | [0;m[38;5;43m20221210132914021 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132914021 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f642f377c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132914022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132914022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132914022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132914022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132914024 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132914024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132914024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132914024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:14.977772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13745): Terminating (SIGTERM) 13:29:15.018880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13748): Terminating (SIGTERM) 13:29:15.060224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13751): Terminating (SIGTERM) 13:29:15.101728 --- ParallelTerminationStrategy: PID 13745 died... 13:29:15.121196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13745): Terminated: ok {rc=0} 13:29:15.166814 --- ParallelTerminationStrategy: PID 13748 died... 13:29:15.186261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13748): Terminated: ok {rc=0} 13:29:15.231683 --- ParallelTerminationStrategy: PID 13751 died... 13:29:15.251055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13751): Terminated: ok {rc=0} 13:29:15.336823 bus /sierra_3: Setting Powered False 13:29:16.439145 bus /sierra_3: Setting Powered False 13:29:17.557383 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:29:18.807785 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:29:18.814017 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:29:18.847333 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:29:18.874198 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:29:18.927559 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:29:18.961044 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:29:18.987948 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:29:19.535937 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:29:19.587007 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:29:19.598387 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:29:19.669551 tst mo_mt_call.py: using LAC 28721 13:29:19.789416 tst mo_mt_call.py: using RAC 161 13:29:19.920645 tst mo_mt_call.py: using CellId 28721 13:29:20.046184 tst mo_mt_call.py: using BVCI 28722 13:29:20.162590 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:29:20.174106 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:29:20.185435 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:29:20.196663 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:29:20.207958 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:29:20.218950 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:29:20.333474 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:29:20.452559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:20.946928 run create_hlr_db(pid=13757): Launched 13:29:21.075625 bus /sierra_2: Setting Powered False 13:29:22.139258 run create_hlr_db(pid=13757): Terminated: ok {rc=0} 13:29:22.565254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13759): Launched 13:29:22.863195 run osmo-hlr_10.42.42.2(pid=13760): Launched 13:29:22.977111 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:23.502615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13762): Launched 13:29:23.801319 run osmo-stp_10.42.42.5(pid=13763): Launched 13:29:23.914776 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:24.456307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13765): Launched 13:29:24.756047 run osmo-msc_10.42.42.6(pid=13766): Launched 13:29:24.924718 run osmo-stp_10.42.42.5(pid=13763): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13763)] 13:29:25.051804 run osmo-stp_10.42.42.5(pid=13763): stdout: | (launched: 2022-12-10_13:29:23.746294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:25.179456 run osmo-stp_10.42.42.5(pid=13763): stderr: | [0;m[38;5;43m20221210132923915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132923915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132923915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132923916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132923916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132923916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132923916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:25.303957 run osmo-stp_10.42.42.5(pid=13763): stdout: | (launched: 2022-12-10_13:29:23.746294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:25.422278 run osmo-stp_10.42.42.5(pid=13763): stderr: | [0;m[38;5;43m20221210132923915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132923915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132923915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132923916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132923916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132923916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132923916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:25.564147 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13763): Process ended prematurely: osmo-stp_10.42.42.5(pid=13763) [trial-2375↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13763)] [trial-2375↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:29:25.572857 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:29:25.598962 run osmo-hlr_10.42.42.2(pid=13760): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13760)] 13:29:25.646205 run osmo-hlr_10.42.42.2(pid=13760): stdout: | (launched: 2022-12-10_13:29:22.808822) 13:29:25.694943 run osmo-hlr_10.42.42.2(pid=13760): stderr: | [0;m[1;31m20221210132922983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132922983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132922983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132922983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132922983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132922983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132922996 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132923006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132923006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132923006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:25.763038 run osmo-msc_10.42.42.6(pid=13766): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13766)] 13:29:25.809845 run osmo-msc_10.42.42.6(pid=13766): stdout: | (launched: 2022-12-10_13:29:24.701090) 13:29:25.858401 run osmo-msc_10.42.42.6(pid=13766): stderr: | [0;m[38;5;43m20221210132924972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132924972 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f47509bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132924972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132924972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132924972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132924973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132924974 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132924975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132924975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132924975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:25.907181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13759): Terminating (SIGTERM) 13:29:25.945817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13762): Terminating (SIGTERM) 13:29:25.984685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13765): Terminating (SIGTERM) 13:29:26.023828 --- ParallelTerminationStrategy: PID 13759 died... 13:29:26.042420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13759): Terminated: ok {rc=0} 13:29:26.086287 --- ParallelTerminationStrategy: PID 13762 died... 13:29:26.104333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13762): Terminated: ok {rc=0} 13:29:26.147583 --- ParallelTerminationStrategy: PID 13765 died... 13:29:26.165654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13765): Terminated: ok {rc=0} 13:29:26.248444 bus /sierra_3: Setting Powered False 13:29:27.345349 bus /sierra_3: Setting Powered False 13:29:28.460677 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:29:29.600913 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:29:29.612266 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:29:29.679936 tst mo_mt_call_osmux.py: using LAC 28722 13:29:29.797890 tst mo_mt_call_osmux.py: using RAC 162 13:29:29.917808 tst mo_mt_call_osmux.py: using CellId 28722 13:29:30.036195 tst mo_mt_call_osmux.py: using BVCI 28723 13:29:30.145469 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:29:30.156235 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:29:30.166919 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:29:30.177779 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:29:30.188612 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:29:30.199570 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:29:30.313746 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:29:30.432722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:30.937758 run create_hlr_db(pid=13768): Launched 13:29:31.080626 bus /sierra_2: Setting Powered False 13:29:32.155068 run create_hlr_db(pid=13768): Terminated: ok {rc=0} 13:29:32.588605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13770): Launched 13:29:32.889701 run osmo-hlr_10.42.42.2(pid=13771): Launched 13:29:33.013525 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:33.528438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13773): Launched 13:29:33.826300 run osmo-stp_10.42.42.5(pid=13774): Launched 13:29:33.940665 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:34.481277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13776): Launched 13:29:34.779368 run osmo-msc_10.42.42.6(pid=13777): Launched 13:29:34.947580 run osmo-stp_10.42.42.5(pid=13774): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13774)] 13:29:35.075062 run osmo-stp_10.42.42.5(pid=13774): stdout: | (launched: 2022-12-10_13:29:33.771936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:35.202277 run osmo-stp_10.42.42.5(pid=13774): stderr: | [0;m[38;5;43m20221210132933939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132933939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132933939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132933940 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132933942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132933942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132933942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:35.326821 run osmo-stp_10.42.42.5(pid=13774): stdout: | (launched: 2022-12-10_13:29:33.771936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:35.445583 run osmo-stp_10.42.42.5(pid=13774): stderr: | [0;m[38;5;43m20221210132933939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132933939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132933939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132933940 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132933942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132933942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132933942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:35.588024 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13774): Process ended prematurely: osmo-stp_10.42.42.5(pid=13774) [trial-2375↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13774)] [trial-2375↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:29:35.596795 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:29:35.623142 run osmo-hlr_10.42.42.2(pid=13771): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13771)] 13:29:35.671251 run osmo-hlr_10.42.42.2(pid=13771): stdout: | (launched: 2022-12-10_13:29:32.831851) 13:29:35.720499 run osmo-hlr_10.42.42.2(pid=13771): stderr: | [0;m[1;31m20221210132933031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132933031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132933031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132933031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132933031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132933031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132933093 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132933102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132933102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132933102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:35.788751 run osmo-msc_10.42.42.6(pid=13777): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13777)] 13:29:35.836158 run osmo-msc_10.42.42.6(pid=13777): stdout: | (launched: 2022-12-10_13:29:34.725012) 13:29:35.885168 run osmo-msc_10.42.42.6(pid=13777): stderr: | [0;m[38;5;43m20221210132934994 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132934994 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c8597fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132934994 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132934994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132934994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132934995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132934997 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132934997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132934998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132934998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:35.934564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13770): Terminating (SIGTERM) 13:29:35.973977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13773): Terminating (SIGTERM) 13:29:36.013331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13776): Terminating (SIGTERM) 13:29:36.053589 --- ParallelTerminationStrategy: PID 13770 died... 13:29:36.072375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13770): Terminated: ok {rc=0} 13:29:36.116331 --- ParallelTerminationStrategy: PID 13773 died... 13:29:36.134853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13773): Terminated: ok {rc=0} 13:29:36.178835 --- ParallelTerminationStrategy: PID 13776 died... 13:29:36.197379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13776): Terminated: ok {rc=0} 13:29:36.281240 bus /sierra_3: Setting Powered False 13:29:37.377215 bus /sierra_3: Setting Powered False 13:29:38.490566 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 emergency:trx-lms --------------------------------------------------------------------- 13:29:39.742179 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:29:39.747573 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 13:29:39.780737 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 13:29:39.806791 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 13:29:39.889571 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 13:29:39.921880 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 13:29:39.949959 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 13:29:40.530685 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2375 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 13:29:40.536181 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:29:40.546801 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 13:29:40.599540 tst emergency_mo_mt_call.py: using LAC 28723 13:29:40.715479 tst emergency_mo_mt_call.py: using RAC 163 13:29:40.829432 tst emergency_mo_mt_call.py: using CellId 28723 13:29:40.951837 tst emergency_mo_mt_call.py: using BVCI 28724 13:29:41.065239 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:29:41.076276 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:29:41.087535 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:29:41.098749 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:29:41.110015 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:29:41.121185 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:29:41.235958 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:29:41.356918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:41.843444 run create_hlr_db(pid=13783): Launched 13:29:41.970671 bus /sierra_2: Setting Powered False 13:29:43.031527 run create_hlr_db(pid=13783): Terminated: ok {rc=0} 13:29:43.450424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13785): Launched 13:29:43.744602 run osmo-hlr_10.42.42.2(pid=13786): Launched 13:29:43.856270 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:44.364486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13788): Launched 13:29:44.657184 run osmo-stp_10.42.42.5(pid=13789): Launched 13:29:44.779320 tst emergency_mo_mt_call.py: using MSISDN 7757 13:29:44.931475 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:45.459024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13791): Launched 13:29:45.751150 run osmo-msc_10.42.42.6(pid=13792): Launched 13:29:45.970803 run osmo-stp_10.42.42.5(pid=13789): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13789)] 13:29:46.240128 run osmo-stp_10.42.42.5(pid=13789): stdout: | (launched: 2022-12-10_13:29:44.603654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:46.499583 run osmo-stp_10.42.42.5(pid=13789): stderr: | [0;m[38;5;43m20221210132944774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132944774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132944774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132944774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132944775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132944775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132944775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:46.626544 run osmo-stp_10.42.42.5(pid=13789): stdout: | (launched: 2022-12-10_13:29:44.603654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:46.747716 run osmo-stp_10.42.42.5(pid=13789): stderr: | [0;m[38;5;43m20221210132944774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132944774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132944774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132944774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132944775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132944775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132944775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:46.892279 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13789): Process ended prematurely: osmo-stp_10.42.42.5(pid=13789) [trial-2375↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13789)] [trial-2375↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 13:29:46.901599 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 13:29:46.930789 run osmo-hlr_10.42.42.2(pid=13786): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13786)] 13:29:46.981123 run osmo-hlr_10.42.42.2(pid=13786): stdout: | (launched: 2022-12-10_13:29:43.690923) 13:29:47.032663 run osmo-hlr_10.42.42.2(pid=13786): stderr: | [0;m[1;31m20221210132943866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132943866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132943866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132943866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132943866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132943866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132943879 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132943887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132943887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132943887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:47.104532 run osmo-msc_10.42.42.6(pid=13792): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13792)] 13:29:47.154725 run osmo-msc_10.42.42.6(pid=13792): stdout: | (launched: 2022-12-10_13:29:45.697355) 13:29:47.206260 run osmo-msc_10.42.42.6(pid=13792): stderr: | [0;m[38;5;43m20221210132946192 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132946194 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd89260ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132946194 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132946194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132946194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132946195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132946199 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132946200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132946201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132946201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:47.258213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13785): Terminating (SIGTERM) 13:29:47.299871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13788): Terminating (SIGTERM) 13:29:47.341450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13791): Terminating (SIGTERM) 13:29:47.381975 --- ParallelTerminationStrategy: PID 13785 died... 13:29:47.400748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13785): Terminated: ok {rc=0} 13:29:47.446074 --- ParallelTerminationStrategy: PID 13788 died... 13:29:47.464524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13788): Terminated: ok {rc=0} 13:29:47.509530 --- ParallelTerminationStrategy: PID 13791 died... 13:29:47.527871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13791): Terminated: ok {rc=0} 13:29:47.614292 bus /sierra_3: Setting Powered False 13:29:48.712376 bus /sierra_3: Setting Powered False 13:29:49.826498 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 13:29:50.913293 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:29:50.924879 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 13:29:50.977634 tst emergency_preemptive_call.py: using LAC 28724 13:29:51.103598 tst emergency_preemptive_call.py: using RAC 164 13:29:51.225302 tst emergency_preemptive_call.py: using CellId 28724 13:29:51.346870 tst emergency_preemptive_call.py: using BVCI 28725 13:29:51.460302 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:29:51.471472 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:29:51.482248 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:29:51.493210 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:29:51.504132 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:29:51.514968 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:29:51.632006 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:29:51.752760 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:29:51.868815 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:29:51.985445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:52.470559 run create_hlr_db(pid=13795): Launched 13:29:52.597500 bus /sierra_2: Setting Powered False 13:29:53.660180 run create_hlr_db(pid=13795): Terminated: ok {rc=0} 13:29:54.077879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13797): Launched 13:29:54.370432 run osmo-hlr_10.42.42.2(pid=13798): Launched 13:29:54.481432 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:54.984145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13800): Launched 13:29:55.276312 run osmo-stp_10.42.42.5(pid=13801): Launched 13:29:55.397448 tst emergency_preemptive_call.py: using MSISDN 7758 13:29:55.563914 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:56.091040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13803): Launched 13:29:56.383543 run osmo-msc_10.42.42.6(pid=13804): Launched 13:29:56.547759 run osmo-stp_10.42.42.5(pid=13801): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13801)] 13:29:56.672500 run osmo-stp_10.42.42.5(pid=13801): stdout: | (launched: 2022-12-10_13:29:55.222690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:56.796837 run osmo-stp_10.42.42.5(pid=13801): stderr: | [0;m[38;5;43m20221210132955393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132955393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132955393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132955394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132955397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132955397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132955397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:56.919506 run osmo-stp_10.42.42.5(pid=13801): stdout: | (launched: 2022-12-10_13:29:55.222690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:57.035830 run osmo-stp_10.42.42.5(pid=13801): stderr: | [0;m[38;5;43m20221210132955393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210132955393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210132955393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210132955394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210132955397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210132955397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210132955397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:57.175044 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13801): Process ended prematurely: osmo-stp_10.42.42.5(pid=13801) [trial-2375↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13801)] [trial-2375↪emergency:trx-lms↪emergency_preemptive_call.py:32] 13:29:57.183406 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 13:29:57.209905 run osmo-hlr_10.42.42.2(pid=13798): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13798)] 13:29:57.257903 run osmo-hlr_10.42.42.2(pid=13798): stdout: | (launched: 2022-12-10_13:29:54.317074) 13:29:57.307130 run osmo-hlr_10.42.42.2(pid=13798): stderr: | [0;m[1;31m20221210132954493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210132954493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210132954493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210132954493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210132954493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210132954493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210132954505 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210132954514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210132954514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210132954514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:57.376071 run osmo-msc_10.42.42.6(pid=13804): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13804)] 13:29:57.423841 run osmo-msc_10.42.42.6(pid=13804): stdout: | (launched: 2022-12-10_13:29:56.329767) 13:29:57.473302 run osmo-msc_10.42.42.6(pid=13804): stderr: | [0;m[38;5;43m20221210132956603 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210132956603 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdce349cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210132956603 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210132956603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210132956604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210132956604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210132956607 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210132956608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210132956608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210132956608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:57.523614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13797): Terminating (SIGTERM) 13:29:57.563350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13800): Terminating (SIGTERM) 13:29:57.603069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13803): Terminating (SIGTERM) 13:29:57.642827 --- ParallelTerminationStrategy: PID 13797 died... 13:29:57.661798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13797): Terminated: ok {rc=0} 13:29:57.705898 --- ParallelTerminationStrategy: PID 13800 died... 13:29:57.724229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13800): Terminated: ok {rc=0} 13:29:57.768219 --- ParallelTerminationStrategy: PID 13803 died... 13:29:57.786780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13803): Terminated: ok {rc=0} 13:29:57.869757 bus /sierra_9: Setting Powered False 13:29:58.964521 bus /sierra_9: Setting Powered False 13:30:00.078092 bus /sierra_8: Setting Powered False 13:30:01.179455 bus /sierra_8: Setting Powered False 13:30:02.313276 bus /sierra_3: Setting Powered False 13:30:03.410897 bus /sierra_3: Setting Powered False 13:30:04.526949 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-lms --------------------------------------------------------------------- 13:30:05.799253 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:30:05.803555 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 13:30:05.836802 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 13:30:05.874666 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 13:30:05.959780 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 13:30:05.994354 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 13:30:06.033726 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 13:30:06.622727 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 13:30:06.675568 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:06.686572 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:30:06.736199 tst cs_paging_gprs_active.py: using LAC 28725 13:30:06.862924 tst cs_paging_gprs_active.py: using RAC 165 13:30:06.988880 tst cs_paging_gprs_active.py: using CellId 28725 13:30:07.112559 tst cs_paging_gprs_active.py: using BVCI 28726 13:30:07.227582 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:07.238505 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:07.249079 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:07.259703 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:07.270435 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:07.281214 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:07.292131 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:07.302839 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:07.314062 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:30:07.432282 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:30:07.548593 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:30:07.750168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:30:08.049669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13813): Launched 13:30:08.310240 run iperf3-srv_10.42.42.10(pid=13814): Launched 13:30:08.423021 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:30:08.624490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:30:08.925221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13815): Launched 13:30:09.185791 run iperf3-srv_10.42.42.10(pid=13816): Launched 13:30:09.297945 tst cs_paging_gprs_active.py:38: start network... 13:30:09.499370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:09.965223 run create_hlr_db(pid=13817): Launched 13:30:10.079742 bus /sierra_2: Setting Powered False 13:30:11.138937 run create_hlr_db(pid=13817): Terminated: ok {rc=0} 13:30:11.574129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13819): Launched 13:30:11.892649 run osmo-hlr_10.42.42.2(pid=13820): Launched 13:30:12.014672 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:12.566300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13822): Launched 13:30:12.886174 run osmo-stp_10.42.42.5(pid=13823): Launched 13:30:13.007634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:30:13.558207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13825): Launched 13:30:13.679784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:30:13.949022 run patchelf(pid=13826): Launched 13:30:14.126025 run osmo-stp_10.42.42.5(pid=13823): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13823)] 13:30:14.260789 run osmo-stp_10.42.42.5(pid=13823): stdout: | (launched: 2022-12-10_13:30:12.828166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:14.397038 run osmo-stp_10.42.42.5(pid=13823): stderr: | [0;m[38;5;43m20221210133013021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133013021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133013021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133013021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133013022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133013022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133013022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:14.533100 run osmo-stp_10.42.42.5(pid=13823): stdout: | (launched: 2022-12-10_13:30:12.828166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:14.664464 run osmo-stp_10.42.42.5(pid=13823): stderr: | [0;m[38;5;43m20221210133013021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133013021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133013021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133013021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133013022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133013022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133013022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:14.819796 run patchelf(pid=13826): Terminating (SIGINT) 13:30:14.998471 run patchelf(pid=13826): Terminated: ok {rc=0} 13:30:15.127396 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13823): Process ended prematurely: osmo-stp_10.42.42.5(pid=13823) [trial-2375↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13823)] [trial-2375↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 13:30:15.137477 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:30:15.165644 run osmo-hlr_10.42.42.2(pid=13820): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13820)] 13:30:15.215154 run osmo-hlr_10.42.42.2(pid=13820): stdout: | (launched: 2022-12-10_13:30:11.834714) 13:30:15.266320 run osmo-hlr_10.42.42.2(pid=13820): stderr: | [0;m[1;31m20221210133012033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133012033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133012033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133012033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133012033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133012033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133012045 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133012054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133012054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133012054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:15.318022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13813): Terminating (SIGTERM) 13:30:15.358927 run iperf3-srv_10.42.42.10(pid=13814): Terminating (SIGTERM) 13:30:15.399947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13815): Terminating (SIGTERM) 13:30:15.441564 run iperf3-srv_10.42.42.10(pid=13816): Terminating (SIGTERM) 13:30:15.482744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13819): Terminating (SIGTERM) 13:30:15.523763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13822): Terminating (SIGTERM) 13:30:15.565063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13825): Terminating (SIGTERM) 13:30:15.606546 --- ParallelTerminationStrategy: PID 13813 died... 13:30:15.626271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13813): Terminated: ok {rc=0} 13:30:15.672364 --- ParallelTerminationStrategy: PID 13814 died... 13:30:15.691854 run iperf3-srv_10.42.42.10(pid=13814): Terminated {rc=256} 13:30:15.737813 --- ParallelTerminationStrategy: PID 13815 died... 13:30:15.757322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13815): Terminated: ok {rc=0} 13:30:15.802816 --- ParallelTerminationStrategy: PID 13816 died... 13:30:15.822305 run iperf3-srv_10.42.42.10(pid=13816): Terminated {rc=256} 13:30:15.868896 --- ParallelTerminationStrategy: PID 13819 died... 13:30:15.889140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13819): Terminated: ok {rc=0} 13:30:15.949154 --- ParallelTerminationStrategy: PID 13822 died... 13:30:15.968827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13822): Terminated: ok {rc=0} 13:30:16.015304 --- ParallelTerminationStrategy: PID 13825 died... 13:30:16.035893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13825): Terminated: ok {rc=0} 13:30:16.123403 bus /gobi_0: Setting Powered False 13:30:17.219766 bus /gobi_0: Setting Powered False 13:30:18.335237 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms iperf3.py ---------------------------------------------- 13:30:19.479507 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:19.490806 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:30:19.541826 tst iperf3.py: using LAC 28726 13:30:19.668780 tst iperf3.py: using RAC 166 13:30:19.795484 tst iperf3.py: using CellId 28726 13:30:19.924385 tst iperf3.py: using BVCI 28727 13:30:20.042696 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:20.053812 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:20.064584 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:20.075626 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:20.086457 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:20.097225 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:20.108178 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:20.119045 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:20.130029 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:30:20.245538 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:30:20.447173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:30:20.748995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13827): Launched 13:30:21.028542 run iperf3-srv_10.42.42.10(pid=13828): Launched 13:30:21.148610 tst iperf3.py:8: start network... 13:30:21.364357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:21.861511 run create_hlr_db(pid=13829): Launched 13:30:21.992003 bus /gobi_6: Setting Powered False 13:30:23.054626 run create_hlr_db(pid=13829): Terminated: ok {rc=0} 13:30:23.482894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13831): Launched 13:30:23.784465 run osmo-hlr_10.42.42.2(pid=13832): Launched 13:30:23.899934 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:24.433677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13834): Launched 13:30:24.734282 run osmo-stp_10.42.42.5(pid=13835): Launched 13:30:24.848565 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:30:25.363440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13837): Launched 13:30:25.486025 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:30:25.757444 run patchelf(pid=13838): Launched 13:30:25.935389 run osmo-stp_10.42.42.5(pid=13835): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13835)] 13:30:26.071712 run osmo-stp_10.42.42.5(pid=13835): stdout: | (launched: 2022-12-10_13:30:24.679120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:26.208481 run osmo-stp_10.42.42.5(pid=13835): stderr: | [0;m[38;5;43m20221210133024848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133024848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133024848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133024849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133024851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133024851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133024851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:26.345433 run osmo-stp_10.42.42.5(pid=13835): stdout: | (launched: 2022-12-10_13:30:24.679120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:26.476607 run osmo-stp_10.42.42.5(pid=13835): stderr: | [0;m[38;5;43m20221210133024848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133024848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133024848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133024849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133024851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133024851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133024851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:26.632051 run patchelf(pid=13838): Terminating (SIGINT) 13:30:26.812176 run patchelf(pid=13838): Terminated: ok {rc=0} 13:30:26.941498 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13835): Process ended prematurely: osmo-stp_10.42.42.5(pid=13835) [trial-2375↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13835)] [trial-2375↪gprs:trx-lms↪iperf3.py:8] 13:30:26.951352 tst iperf3.py:8: Test FAILED (7.5 sec) 13:30:26.979374 run osmo-hlr_10.42.42.2(pid=13832): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13832)] 13:30:27.028352 run osmo-hlr_10.42.42.2(pid=13832): stdout: | (launched: 2022-12-10_13:30:23.729338) 13:30:27.079151 run osmo-hlr_10.42.42.2(pid=13832): stderr: | [0;m[1;31m20221210133023907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133023907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133023907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133023907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133023907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133023907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133023919 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133023930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133023930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133023930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:27.130487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13827): Terminating (SIGTERM) 13:30:27.171399 run iperf3-srv_10.42.42.10(pid=13828): Terminating (SIGTERM) 13:30:27.212216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13831): Terminating (SIGTERM) 13:30:27.253781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13834): Terminating (SIGTERM) 13:30:27.294988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13837): Terminating (SIGTERM) 13:30:27.336235 --- ParallelTerminationStrategy: PID 13827 died... 13:30:27.356125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13827): Terminated: ok {rc=0} 13:30:27.401558 --- ParallelTerminationStrategy: PID 13828 died... 13:30:27.420417 run iperf3-srv_10.42.42.10(pid=13828): Terminated {rc=256} 13:30:27.465631 --- ParallelTerminationStrategy: PID 13831 died... 13:30:27.484932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13831): Terminated: ok {rc=0} 13:30:27.530069 --- ParallelTerminationStrategy: PID 13834 died... 13:30:27.549339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13834): Terminated: ok {rc=0} 13:30:27.594816 --- ParallelTerminationStrategy: PID 13837 died... 13:30:27.614141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13837): Terminated: ok {rc=0} 13:30:27.700616 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms iperf3m4.py ---------------------------------------------- 13:30:28.848094 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:28.859682 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:30:28.909970 tst iperf3m4.py: using LAC 28727 13:30:29.037029 tst iperf3m4.py: using RAC 167 13:30:29.162156 tst iperf3m4.py: using CellId 28727 13:30:29.287531 tst iperf3m4.py: using BVCI 28728 13:30:29.404234 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:29.415285 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:29.426050 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:29.436773 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:29.447464 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:29.458093 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:29.468928 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:29.479620 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:29.490515 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:30:29.607084 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:30:29.730158 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:30:29.844542 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:30:29.959250 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:30:30.161077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:30:30.461467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13839): Launched 13:30:30.722630 run iperf3-srv_10.42.42.10(pid=13840): Launched 13:30:30.850281 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:30:31.074626 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:30:31.401723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13841): Launched 13:30:31.698018 run iperf3-srv_10.42.42.10(pid=13842): Launched 13:30:31.825855 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:30:32.047837 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:30:32.374002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13843): Launched 13:30:32.651509 run iperf3-srv_10.42.42.10(pid=13844): Launched 13:30:32.772019 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:30:32.986450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:30:33.306277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13845): Launched 13:30:33.583836 run iperf3-srv_10.42.42.10(pid=13846): Launched 13:30:33.704102 tst iperf3m4.py:8: start network... 13:30:33.919251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:34.416215 run create_hlr_db(pid=13847): Launched 13:30:34.545478 bus /gobi_6: Setting Powered False 13:30:35.608892 run create_hlr_db(pid=13847): Terminated: ok {rc=0} 13:30:36.052926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13849): Launched 13:30:36.372191 run osmo-hlr_10.42.42.2(pid=13850): Launched 13:30:36.494400 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:37.049732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13852): Launched 13:30:37.368707 run osmo-stp_10.42.42.5(pid=13853): Launched 13:30:37.490496 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:30:38.042330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13855): Launched 13:30:38.163166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:30:38.432274 run patchelf(pid=13856): Launched 13:30:38.609404 run osmo-stp_10.42.42.5(pid=13853): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13853)] 13:30:38.744440 run osmo-stp_10.42.42.5(pid=13853): stdout: | (launched: 2022-12-10_13:30:37.309679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:38.881154 run osmo-stp_10.42.42.5(pid=13853): stderr: | [0;m[38;5;43m20221210133037504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133037504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133037504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133037505 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133037505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133037505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133037505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:39.017599 run osmo-stp_10.42.42.5(pid=13853): stdout: | (launched: 2022-12-10_13:30:37.309679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:39.148585 run osmo-stp_10.42.42.5(pid=13853): stderr: | [0;m[38;5;43m20221210133037504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133037504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133037504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133037505 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133037505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133037505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133037505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:39.303409 run patchelf(pid=13856): Terminating (SIGINT) 13:30:39.482276 run patchelf(pid=13856): Terminated: ok {rc=0} 13:30:39.611079 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13853): Process ended prematurely: osmo-stp_10.42.42.5(pid=13853) [trial-2375↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13853)] [trial-2375↪gprs:trx-lms↪iperf3m4.py:8] 13:30:39.620884 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:30:39.649303 run osmo-hlr_10.42.42.2(pid=13850): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13850)] 13:30:39.698897 run osmo-hlr_10.42.42.2(pid=13850): stdout: | (launched: 2022-12-10_13:30:36.314139) 13:30:39.750267 run osmo-hlr_10.42.42.2(pid=13850): stderr: | [0;m[1;31m20221210133036512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133036513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133036513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133036513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133036513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133036513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133036525 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133036534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133036534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133036534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:39.801744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13839): Terminating (SIGTERM) 13:30:39.842888 run iperf3-srv_10.42.42.10(pid=13840): Terminating (SIGTERM) 13:30:39.884279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13841): Terminating (SIGTERM) 13:30:39.925988 run iperf3-srv_10.42.42.10(pid=13842): Terminating (SIGTERM) 13:30:39.967356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13843): Terminating (SIGTERM) 13:30:40.008873 run iperf3-srv_10.42.42.10(pid=13844): Terminating (SIGTERM) 13:30:40.050427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13845): Terminating (SIGTERM) 13:30:40.091794 run iperf3-srv_10.42.42.10(pid=13846): Terminating (SIGTERM) 13:30:40.133145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13849): Terminating (SIGTERM) 13:30:40.174760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13852): Terminating (SIGTERM) 13:30:40.216338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13855): Terminating (SIGTERM) 13:30:40.258353 --- ParallelTerminationStrategy: PID 13839 died... 13:30:40.278230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13839): Terminated: ok {rc=0} 13:30:40.324402 --- ParallelTerminationStrategy: PID 13840 died... 13:30:40.344017 run iperf3-srv_10.42.42.10(pid=13840): Terminated {rc=256} 13:30:40.389538 --- ParallelTerminationStrategy: PID 13841 died... 13:30:40.408828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13841): Terminated: ok {rc=0} 13:30:40.454538 --- ParallelTerminationStrategy: PID 13842 died... 13:30:40.473890 run iperf3-srv_10.42.42.10(pid=13842): Terminated {rc=256} 13:30:40.519612 --- ParallelTerminationStrategy: PID 13843 died... 13:30:40.539060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13843): Terminated: ok {rc=0} 13:30:40.584723 --- ParallelTerminationStrategy: PID 13844 died... 13:30:40.604131 run iperf3-srv_10.42.42.10(pid=13844): Terminated {rc=256} 13:30:40.649660 --- ParallelTerminationStrategy: PID 13845 died... 13:30:40.669400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13845): Terminated: ok {rc=0} 13:30:40.715325 --- ParallelTerminationStrategy: PID 13846 died... 13:30:40.734660 run iperf3-srv_10.42.42.10(pid=13846): Terminated {rc=256} 13:30:40.780340 --- ParallelTerminationStrategy: PID 13849 died... 13:30:40.799840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13849): Terminated: ok {rc=0} 13:30:40.845845 --- ParallelTerminationStrategy: PID 13852 died... 13:30:40.865393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13852): Terminated: ok {rc=0} 13:30:40.911140 --- ParallelTerminationStrategy: PID 13855 died... 13:30:40.930595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13855): Terminated: ok {rc=0} 13:30:41.017784 bus /gobi_4: Setting Powered False 13:30:42.117628 bus /gobi_4: Setting Powered False 13:30:43.234239 bus /gobi_1: Setting Powered False 13:30:44.331929 bus /gobi_1: Setting Powered False 13:30:45.447441 bus /gobi_0: Setting Powered False 13:30:46.547224 bus /gobi_0: Setting Powered False 13:30:47.666328 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms ping.py ---------------------------------------------- 13:30:48.768612 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:48.779654 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:30:48.828128 tst ping.py: using LAC 28728 13:30:48.946115 tst ping.py: using RAC 168 13:30:49.062683 tst ping.py: using CellId 28728 13:30:49.181313 tst ping.py: using BVCI 28729 13:30:49.290021 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:49.300395 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:49.310732 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:49.321284 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:49.331622 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:49.341841 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:49.352484 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:49.362934 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:30:49.480479 tst ping.py:19: start network... 13:30:49.691675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:50.175844 run create_hlr_db(pid=13857): Launched 13:30:50.302849 bus /gobi_6: Setting Powered False 13:30:51.365687 run create_hlr_db(pid=13857): Terminated: ok {rc=0} 13:30:51.803164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13859): Launched 13:30:52.114130 run osmo-hlr_10.42.42.2(pid=13860): Launched 13:30:52.232598 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:52.774371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13862): Launched 13:30:53.086615 run osmo-stp_10.42.42.5(pid=13863): Launched 13:30:53.205380 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:30:53.744253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13865): Launched 13:30:53.863841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:30:54.128003 run patchelf(pid=13866): Launched 13:30:54.302536 run osmo-stp_10.42.42.5(pid=13863): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13863)] 13:30:54.435495 run osmo-stp_10.42.42.5(pid=13863): stdout: | (launched: 2022-12-10_13:30:53.029651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:54.569852 run osmo-stp_10.42.42.5(pid=13863): stderr: | [0;m[38;5;43m20221210133053222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133053222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133053222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133053223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133053223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133053223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133053223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:54.704908 run osmo-stp_10.42.42.5(pid=13863): stdout: | (launched: 2022-12-10_13:30:53.029651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:54.834191 run osmo-stp_10.42.42.5(pid=13863): stderr: | [0;m[38;5;43m20221210133053222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133053222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133053222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133053223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133053223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133053223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133053223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:54.987796 run patchelf(pid=13866): Terminating (SIGINT) 13:30:55.164118 run patchelf(pid=13866): Terminated: ok {rc=0} 13:30:55.290858 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13863): Process ended prematurely: osmo-stp_10.42.42.5(pid=13863) [trial-2375↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13863)] [trial-2375↪gprs:trx-lms↪ping.py:22] 13:30:55.300175 tst ping.py:22: Test FAILED (6.5 sec) 13:30:55.327827 run osmo-hlr_10.42.42.2(pid=13860): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13860)] 13:30:55.377056 run osmo-hlr_10.42.42.2(pid=13860): stdout: | (launched: 2022-12-10_13:30:52.057324) 13:30:55.427784 run osmo-hlr_10.42.42.2(pid=13860): stderr: | [0;m[1;31m20221210133052254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133052254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133052254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133052254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133052254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133052254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133052267 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133052275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133052275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133052275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:55.479008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13859): Terminating (SIGTERM) 13:30:55.520114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13862): Terminating (SIGTERM) 13:30:55.561281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13865): Terminating (SIGTERM) 13:30:55.602726 --- ParallelTerminationStrategy: PID 13859 died... 13:30:55.622368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13859): Terminated: ok {rc=0} 13:30:55.667647 --- ParallelTerminationStrategy: PID 13862 died... 13:30:55.687254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13862): Terminated: ok {rc=0} 13:30:55.732565 --- ParallelTerminationStrategy: PID 13865 died... 13:30:55.751768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13865): Terminated: ok {rc=0} 13:30:55.838432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 13:30:56.925709 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:56.937671 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:30:56.991503 tst ping_idle_ping.py: using LAC 28729 13:30:57.113745 tst ping_idle_ping.py: using RAC 169 13:30:57.236797 tst ping_idle_ping.py: using CellId 28729 13:30:57.358247 tst ping_idle_ping.py: using BVCI 28730 13:30:57.471878 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:57.482860 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:57.493876 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:57.504740 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:57.515577 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:57.526351 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:57.537174 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:30:57.547921 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:30:57.662273 tst ping_idle_ping.py:24: start network... 13:30:57.861082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:58.318438 run create_hlr_db(pid=13867): Launched 13:30:58.431623 bus /gobi_6: Setting Powered False 13:30:59.490279 run create_hlr_db(pid=13867): Terminated: ok {rc=0} 13:30:59.922477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13869): Launched 13:31:00.236516 run osmo-hlr_10.42.42.2(pid=13870): Launched 13:31:00.356250 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:00.937873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13872): Launched 13:31:01.265873 run osmo-stp_10.42.42.5(pid=13873): Launched 13:31:01.410992 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:31:02.175049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13875): Launched 13:31:02.302452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:31:02.570456 run patchelf(pid=13876): Launched 13:31:02.745953 run osmo-stp_10.42.42.5(pid=13873): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13873)] 13:31:02.879247 run osmo-stp_10.42.42.5(pid=13873): stdout: | (launched: 2022-12-10_13:31:01.200764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:03.014311 run osmo-stp_10.42.42.5(pid=13873): stderr: | [0;m[38;5;43m20221210133101567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133101567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133101568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133101568 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133101568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133101574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133101575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:03.148926 run osmo-stp_10.42.42.5(pid=13873): stdout: | (launched: 2022-12-10_13:31:01.200764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:03.278350 run osmo-stp_10.42.42.5(pid=13873): stderr: | [0;m[38;5;43m20221210133101567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133101567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133101568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133101568 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133101568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133101574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133101575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:03.431745 run patchelf(pid=13876): Terminating (SIGINT) 13:31:03.608725 run patchelf(pid=13876): Terminated: ok {rc=0} 13:31:03.736335 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13873): Process ended prematurely: osmo-stp_10.42.42.5(pid=13873) [trial-2375↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13873)] [trial-2375↪gprs:trx-lms↪ping_idle_ping.py:27] 13:31:03.745683 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 13:31:03.773501 run osmo-hlr_10.42.42.2(pid=13870): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13870)] 13:31:03.823457 run osmo-hlr_10.42.42.2(pid=13870): stdout: | (launched: 2022-12-10_13:31:00.179418) 13:31:03.874989 run osmo-hlr_10.42.42.2(pid=13870): stderr: | [0;m[1;31m20221210133100377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133100377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133100377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133100377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133100377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133100377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133100391 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133100401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133100401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133100401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:03.927041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13869): Terminating (SIGTERM) 13:31:03.968318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13872): Terminating (SIGTERM) 13:31:04.010016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13875): Terminating (SIGTERM) 13:31:04.051886 --- ParallelTerminationStrategy: PID 13869 died... 13:31:04.071889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13869): Terminated: ok {rc=0} 13:31:04.118068 --- ParallelTerminationStrategy: PID 13872 died... 13:31:04.137397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13872): Terminated: ok {rc=0} 13:31:04.183717 --- ParallelTerminationStrategy: PID 13875 died... 13:31:04.203228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13875): Terminated: ok {rc=0} 13:31:04.289980 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 13:31:05.584569 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:31:05.590023 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:31:05.624413 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:31:05.663119 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:31:05.748646 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:31:05.781701 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:31:05.820041 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:31:06.409768 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:31:06.462997 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:06.474277 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:31:06.525494 tst cs_paging_gprs_active.py: using LAC 28730 13:31:06.647435 tst cs_paging_gprs_active.py: using RAC 170 13:31:06.768231 tst cs_paging_gprs_active.py: using CellId 28730 13:31:06.889343 tst cs_paging_gprs_active.py: using BVCI 28731 13:31:07.001342 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:07.012059 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:07.022659 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:07.033539 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:07.044194 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:07.054899 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:07.065808 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:07.076352 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:07.087114 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:31:07.206497 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:31:07.322657 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:31:07.526345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:31:07.828865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13880): Launched 13:31:08.091170 run iperf3-srv_10.42.42.10(pid=13881): Launched 13:31:08.204235 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:31:08.405159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:31:08.707103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13882): Launched 13:31:08.969893 run iperf3-srv_10.42.42.10(pid=13883): Launched 13:31:09.083872 tst cs_paging_gprs_active.py:38: start network... 13:31:09.286639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:09.753619 run create_hlr_db(pid=13884): Launched 13:31:09.867281 bus /gobi_6: Setting Powered False 13:31:10.927124 run create_hlr_db(pid=13884): Terminated: ok {rc=0} 13:31:11.364776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13886): Launched 13:31:11.684113 run osmo-hlr_10.42.42.2(pid=13887): Launched 13:31:11.806698 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:12.355433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13889): Launched 13:31:12.673913 run osmo-stp_10.42.42.5(pid=13890): Launched 13:31:12.796143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:31:13.349480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13892): Launched 13:31:13.471650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:31:13.743930 run patchelf(pid=13893): Launched 13:31:13.922882 run osmo-stp_10.42.42.5(pid=13890): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13890)] 13:31:14.058411 run osmo-stp_10.42.42.5(pid=13890): stdout: | (launched: 2022-12-10_13:31:12.615867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:14.195073 run osmo-stp_10.42.42.5(pid=13890): stderr: | [0;m[38;5;43m20221210133112806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133112806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133112806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133112807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133112807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133112807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133112807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:14.332096 run osmo-stp_10.42.42.5(pid=13890): stdout: | (launched: 2022-12-10_13:31:12.615867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:14.463447 run osmo-stp_10.42.42.5(pid=13890): stderr: | [0;m[38;5;43m20221210133112806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133112806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133112806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133112807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133112807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133112807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133112807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:14.619476 run patchelf(pid=13893): Terminating (SIGINT) 13:31:14.800239 run patchelf(pid=13893): Terminated: ok {rc=0} 13:31:14.930022 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13890): Process ended prematurely: osmo-stp_10.42.42.5(pid=13890) [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13890)] [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:31:14.940308 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:31:14.968909 run osmo-hlr_10.42.42.2(pid=13887): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13887)] 13:31:15.018847 run osmo-hlr_10.42.42.2(pid=13887): stdout: | (launched: 2022-12-10_13:31:11.625965) 13:31:15.070279 run osmo-hlr_10.42.42.2(pid=13887): stderr: | [0;m[1;31m20221210133111825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133111825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133111825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133111825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133111825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133111825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133111837 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133111846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133111846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133111846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:15.122362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13880): Terminating (SIGTERM) 13:31:15.163741 run iperf3-srv_10.42.42.10(pid=13881): Terminating (SIGTERM) 13:31:15.205071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13882): Terminating (SIGTERM) 13:31:15.246751 run iperf3-srv_10.42.42.10(pid=13883): Terminating (SIGTERM) 13:31:15.288164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13886): Terminating (SIGTERM) 13:31:15.329632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13889): Terminating (SIGTERM) 13:31:15.371148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13892): Terminating (SIGTERM) 13:31:15.412807 --- ParallelTerminationStrategy: PID 13880 died... 13:31:15.432631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13880): Terminated: ok {rc=0} 13:31:15.478751 --- ParallelTerminationStrategy: PID 13881 died... 13:31:15.498215 run iperf3-srv_10.42.42.10(pid=13881): Terminated {rc=256} 13:31:15.544036 --- ParallelTerminationStrategy: PID 13882 died... 13:31:15.563556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13882): Terminated: ok {rc=0} 13:31:15.609099 --- ParallelTerminationStrategy: PID 13883 died... 13:31:15.628452 run iperf3-srv_10.42.42.10(pid=13883): Terminated {rc=256} 13:31:15.673947 --- ParallelTerminationStrategy: PID 13886 died... 13:31:15.693653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13886): Terminated: ok {rc=0} 13:31:15.739442 --- ParallelTerminationStrategy: PID 13889 died... 13:31:15.758876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13889): Terminated: ok {rc=0} 13:31:15.804634 --- ParallelTerminationStrategy: PID 13892 died... 13:31:15.824060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13892): Terminated: ok {rc=0} 13:31:15.929917 bus /gobi_0: Setting Powered False 13:31:17.034093 bus /gobi_0: Setting Powered False 13:31:18.151721 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:31:19.296255 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:19.307559 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:31:19.357861 tst iperf3.py: using LAC 28731 13:31:19.480846 tst iperf3.py: using RAC 171 13:31:19.599788 tst iperf3.py: using CellId 28731 13:31:19.717369 tst iperf3.py: using BVCI 28732 13:31:19.827318 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:19.838061 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:19.848495 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:19.859204 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:19.869920 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:19.880577 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:19.891524 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:19.902165 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:19.913015 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:31:20.030171 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:31:20.246832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:31:20.569265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13894): Launched 13:31:20.847702 run iperf3-srv_10.42.42.10(pid=13895): Launched 13:31:20.967675 tst iperf3.py:8: start network... 13:31:21.183665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:21.679283 run create_hlr_db(pid=13896): Launched 13:31:21.809728 bus /gobi_6: Setting Powered False 13:31:22.873492 run create_hlr_db(pid=13896): Terminated: ok {rc=0} 13:31:23.300940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13898): Launched 13:31:23.600001 run osmo-hlr_10.42.42.2(pid=13899): Launched 13:31:23.713919 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:24.230429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13901): Launched 13:31:24.530046 run osmo-stp_10.42.42.5(pid=13902): Launched 13:31:24.644400 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:31:25.162458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13904): Launched 13:31:25.277009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:31:25.529493 run patchelf(pid=13905): Launched 13:31:25.696742 run osmo-stp_10.42.42.5(pid=13902): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13902)] 13:31:25.824024 run osmo-stp_10.42.42.5(pid=13902): stdout: | (launched: 2022-12-10_13:31:24.475073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:25.953551 run osmo-stp_10.42.42.5(pid=13902): stderr: | [0;m[38;5;43m20221210133124647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133124647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133124648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133124648 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133124648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133124649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133124649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:26.082927 run osmo-stp_10.42.42.5(pid=13902): stdout: | (launched: 2022-12-10_13:31:24.475073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:26.206714 run osmo-stp_10.42.42.5(pid=13902): stderr: | [0;m[38;5;43m20221210133124647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133124647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133124648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133124648 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133124648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133124649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133124649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:26.353370 run patchelf(pid=13905): Terminating (SIGINT) 13:31:26.522818 run patchelf(pid=13905): Terminated: ok {rc=0} 13:31:26.644803 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13902): Process ended prematurely: osmo-stp_10.42.42.5(pid=13902) [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13902)] [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 13:31:26.654139 tst iperf3.py:8: Test FAILED (7.4 sec) 13:31:26.681299 run osmo-hlr_10.42.42.2(pid=13899): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13899)] 13:31:26.729720 run osmo-hlr_10.42.42.2(pid=13899): stdout: | (launched: 2022-12-10_13:31:23.545159) 13:31:26.779181 run osmo-hlr_10.42.42.2(pid=13899): stderr: | [0;m[1;31m20221210133123721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133123721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133123721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133123721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133123721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133123721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133123734 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133123742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133123743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133123743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:26.829304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13894): Terminating (SIGTERM) 13:31:26.869163 run iperf3-srv_10.42.42.10(pid=13895): Terminating (SIGTERM) 13:31:26.908917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13898): Terminating (SIGTERM) 13:31:26.948691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13901): Terminating (SIGTERM) 13:31:26.988425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13904): Terminating (SIGTERM) 13:31:27.028503 --- ParallelTerminationStrategy: PID 13894 died... 13:31:27.047647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13894): Terminated: ok {rc=0} 13:31:27.092119 --- ParallelTerminationStrategy: PID 13895 died... 13:31:27.110692 run iperf3-srv_10.42.42.10(pid=13895): Terminated {rc=256} 13:31:27.155251 --- ParallelTerminationStrategy: PID 13898 died... 13:31:27.173819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13898): Terminated: ok {rc=0} 13:31:27.218312 --- ParallelTerminationStrategy: PID 13901 died... 13:31:27.236646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13901): Terminated: ok {rc=0} 13:31:27.280900 --- ParallelTerminationStrategy: PID 13904 died... 13:31:27.299879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13904): Terminated: ok {rc=0} 13:31:27.384281 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:31:28.532802 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:28.544555 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:31:28.597683 tst iperf3m4.py: using LAC 28732 13:31:28.725488 tst iperf3m4.py: using RAC 172 13:31:28.851301 tst iperf3m4.py: using CellId 28732 13:31:28.983970 tst iperf3m4.py: using BVCI 28733 13:31:29.102806 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:29.114182 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:29.125091 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:29.136195 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:29.147233 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:29.158282 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:29.169580 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:29.180465 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:29.191649 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:31:29.308617 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:31:29.425844 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:31:29.544659 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:31:29.661653 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:31:29.863794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:31:30.166095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13906): Launched 13:31:30.426158 run iperf3-srv_10.42.42.10(pid=13907): Launched 13:31:30.538719 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:31:30.739518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:31:31.089831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13908): Launched 13:31:31.381429 run iperf3-srv_10.42.42.10(pid=13909): Launched 13:31:31.509688 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:31:31.732530 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:31:32.074400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13910): Launched 13:31:32.356000 run iperf3-srv_10.42.42.10(pid=13911): Launched 13:31:32.477050 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:31:32.684222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:31:32.985963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13912): Launched 13:31:33.246607 run iperf3-srv_10.42.42.10(pid=13913): Launched 13:31:33.358851 tst iperf3m4.py:8: start network... 13:31:33.559305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:34.023791 run create_hlr_db(pid=13914): Launched 13:31:34.139729 bus /gobi_6: Setting Powered False 13:31:35.200442 run create_hlr_db(pid=13914): Terminated: ok {rc=0} 13:31:35.617314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13916): Launched 13:31:35.916573 run osmo-hlr_10.42.42.2(pid=13917): Launched 13:31:36.031555 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:36.551648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13919): Launched 13:31:36.850428 run osmo-stp_10.42.42.5(pid=13920): Launched 13:31:36.964453 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:31:37.482658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13922): Launched 13:31:37.596641 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:31:37.850461 run patchelf(pid=13923): Launched 13:31:38.016859 run osmo-stp_10.42.42.5(pid=13920): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13920)] 13:31:38.143256 run osmo-stp_10.42.42.5(pid=13920): stdout: | (launched: 2022-12-10_13:31:36.795487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:38.271552 run osmo-stp_10.42.42.5(pid=13920): stderr: | [0;m[38;5;43m20221210133136964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133136964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133136964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133136965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133136967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133136967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133136967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:38.399736 run osmo-stp_10.42.42.5(pid=13920): stdout: | (launched: 2022-12-10_13:31:36.795487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:38.522515 run osmo-stp_10.42.42.5(pid=13920): stderr: | [0;m[38;5;43m20221210133136964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133136964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133136964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133136965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133136967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133136967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133136967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:38.668058 run patchelf(pid=13923): Terminating (SIGINT) 13:31:38.836797 run patchelf(pid=13923): Terminated: ok {rc=0} 13:31:38.958947 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13920): Process ended prematurely: osmo-stp_10.42.42.5(pid=13920) [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13920)] [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 13:31:38.968026 tst iperf3m4.py:8: Test FAILED (10.5 sec) 13:31:38.995579 run osmo-hlr_10.42.42.2(pid=13917): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13917)] 13:31:39.042943 run osmo-hlr_10.42.42.2(pid=13917): stdout: | (launched: 2022-12-10_13:31:35.861983) 13:31:39.091753 run osmo-hlr_10.42.42.2(pid=13917): stderr: | [0;m[1;31m20221210133136039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133136039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133136039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133136039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133136039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133136039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133136051 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133136062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133136062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133136062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:39.141052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13906): Terminating (SIGTERM) 13:31:39.180341 run iperf3-srv_10.42.42.10(pid=13907): Terminating (SIGTERM) 13:31:39.219710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13908): Terminating (SIGTERM) 13:31:39.259170 run iperf3-srv_10.42.42.10(pid=13909): Terminating (SIGTERM) 13:31:39.298318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13910): Terminating (SIGTERM) 13:31:39.337974 run iperf3-srv_10.42.42.10(pid=13911): Terminating (SIGTERM) 13:31:39.377303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13912): Terminating (SIGTERM) 13:31:39.416732 run iperf3-srv_10.42.42.10(pid=13913): Terminating (SIGTERM) 13:31:39.455980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13916): Terminating (SIGTERM) 13:31:39.495272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13919): Terminating (SIGTERM) 13:31:39.534531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13922): Terminating (SIGTERM) 13:31:39.574009 --- ParallelTerminationStrategy: PID 13906 died... 13:31:39.592823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13906): Terminated: ok {rc=0} 13:31:39.637069 --- ParallelTerminationStrategy: PID 13907 died... 13:31:39.655299 run iperf3-srv_10.42.42.10(pid=13907): Terminated {rc=256} 13:31:39.699042 --- ParallelTerminationStrategy: PID 13908 died... 13:31:39.717126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13908): Terminated: ok {rc=0} 13:31:39.760570 --- ParallelTerminationStrategy: PID 13909 died... 13:31:39.778693 run iperf3-srv_10.42.42.10(pid=13909): Terminated {rc=256} 13:31:39.822050 --- ParallelTerminationStrategy: PID 13910 died... 13:31:39.840214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13910): Terminated: ok {rc=0} 13:31:39.883325 --- ParallelTerminationStrategy: PID 13911 died... 13:31:39.901837 run iperf3-srv_10.42.42.10(pid=13911): Terminated {rc=256} 13:31:39.945072 --- ParallelTerminationStrategy: PID 13912 died... 13:31:39.963287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13912): Terminated: ok {rc=0} 13:31:40.007179 --- ParallelTerminationStrategy: PID 13913 died... 13:31:40.025497 run iperf3-srv_10.42.42.10(pid=13913): Terminated {rc=256} 13:31:40.069183 --- ParallelTerminationStrategy: PID 13916 died... 13:31:40.087309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13916): Terminated: ok {rc=0} 13:31:40.130751 --- ParallelTerminationStrategy: PID 13919 died... 13:31:40.149048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13919): Terminated: ok {rc=0} 13:31:40.192461 --- ParallelTerminationStrategy: PID 13922 died... 13:31:40.210778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13922): Terminated: ok {rc=0} 13:31:40.293019 bus /gobi_4: Setting Powered False 13:31:41.390254 bus /gobi_4: Setting Powered False 13:31:42.507722 bus /gobi_1: Setting Powered False 13:31:43.607047 bus /gobi_1: Setting Powered False 13:31:44.721134 bus /gobi_0: Setting Powered False 13:31:45.817648 bus /gobi_0: Setting Powered False 13:31:46.942663 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 13:31:48.043703 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:48.055087 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:31:48.109775 tst ping.py: using LAC 28733 13:31:48.227127 tst ping.py: using RAC 173 13:31:48.342113 tst ping.py: using CellId 28733 13:31:48.459155 tst ping.py: using BVCI 28734 13:31:48.566975 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:48.577862 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:48.588392 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:48.599296 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:48.610118 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:48.620934 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:48.631889 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:48.642682 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:31:48.758415 tst ping.py:19: start network... 13:31:48.969631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:49.454629 run create_hlr_db(pid=13924): Launched 13:31:49.581754 bus /gobi_6: Setting Powered False 13:31:50.643703 run create_hlr_db(pid=13924): Terminated: ok {rc=0} 13:31:51.079346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13926): Launched 13:31:51.391757 run osmo-hlr_10.42.42.2(pid=13927): Launched 13:31:51.511357 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:52.053550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13929): Launched 13:31:52.367538 run osmo-stp_10.42.42.5(pid=13930): Launched 13:31:52.486816 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:31:53.027695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13932): Launched 13:31:53.147344 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:31:53.412711 run patchelf(pid=13933): Launched 13:31:53.588165 run osmo-stp_10.42.42.5(pid=13930): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13930)] 13:31:53.721369 run osmo-stp_10.42.42.5(pid=13930): stdout: | (launched: 2022-12-10_13:31:52.309027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:53.855606 run osmo-stp_10.42.42.5(pid=13930): stderr: | [0;m[38;5;43m20221210133152499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133152499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133152499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133152500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133152500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133152500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133152500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:53.990088 run osmo-stp_10.42.42.5(pid=13930): stdout: | (launched: 2022-12-10_13:31:52.309027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:54.118913 run osmo-stp_10.42.42.5(pid=13930): stderr: | [0;m[38;5;43m20221210133152499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133152499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133152499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133152500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133152500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133152500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133152500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:54.271599 run patchelf(pid=13933): Terminating (SIGINT) 13:31:54.447783 run patchelf(pid=13933): Terminated: ok {rc=0} 13:31:54.574534 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13930): Process ended prematurely: osmo-stp_10.42.42.5(pid=13930) [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13930)] [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 13:31:54.583911 tst ping.py:22: Test FAILED (6.5 sec) 13:31:54.611662 run osmo-hlr_10.42.42.2(pid=13927): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13927)] 13:31:54.661207 run osmo-hlr_10.42.42.2(pid=13927): stdout: | (launched: 2022-12-10_13:31:51.334398) 13:31:54.712666 run osmo-hlr_10.42.42.2(pid=13927): stderr: | [0;m[1;31m20221210133151533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133151533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133151533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133151533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133151533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133151533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133151545 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133151553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133151554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133151554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:54.764541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13926): Terminating (SIGTERM) 13:31:54.805686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13929): Terminating (SIGTERM) 13:31:54.846899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13932): Terminating (SIGTERM) 13:31:54.888869 --- ParallelTerminationStrategy: PID 13926 died... 13:31:54.908654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13926): Terminated: ok {rc=0} 13:31:54.954958 --- ParallelTerminationStrategy: PID 13929 died... 13:31:54.974452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13929): Terminated: ok {rc=0} 13:31:55.020095 --- ParallelTerminationStrategy: PID 13932 died... 13:31:55.039511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13932): Terminated: ok {rc=0} 13:31:55.127070 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:31:56.212490 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:56.224234 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:31:56.277570 tst ping_idle_ping.py: using LAC 28734 13:31:56.401226 tst ping_idle_ping.py: using RAC 174 13:31:56.526689 tst ping_idle_ping.py: using CellId 28734 13:31:56.651748 tst ping_idle_ping.py: using BVCI 28735 13:31:56.766637 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:56.777944 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:56.788904 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:56.800473 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:56.811960 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:56.823467 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:56.835226 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:31:56.846776 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:31:56.961493 tst ping_idle_ping.py:24: start network... 13:31:57.159431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:57.618499 run create_hlr_db(pid=13934): Launched 13:31:57.731203 bus /gobi_6: Setting Powered False 13:31:58.790228 run create_hlr_db(pid=13934): Terminated: ok {rc=0} 13:31:59.202455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13936): Launched 13:31:59.497480 run osmo-hlr_10.42.42.2(pid=13937): Launched 13:31:59.610545 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:00.135805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13939): Launched 13:32:00.430752 run osmo-stp_10.42.42.5(pid=13940): Launched 13:32:00.543371 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:32:01.089924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13942): Launched 13:32:01.219220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:32:01.501491 run patchelf(pid=13943): Launched 13:32:01.693173 run osmo-stp_10.42.42.5(pid=13940): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13940)] 13:32:01.831991 run osmo-stp_10.42.42.5(pid=13940): stdout: | (launched: 2022-12-10_13:32:00.376393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:01.972012 run osmo-stp_10.42.42.5(pid=13940): stderr: | [0;m[38;5;43m20221210133200544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133200544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133200544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133200545 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133200547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133200547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133200547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:02.111442 run osmo-stp_10.42.42.5(pid=13940): stdout: | (launched: 2022-12-10_13:32:00.376393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:02.246438 run osmo-stp_10.42.42.5(pid=13940): stderr: | [0;m[38;5;43m20221210133200544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133200544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133200544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133200545 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133200547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133200547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133200547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:02.400453 run patchelf(pid=13943): Terminating (SIGINT) 13:32:02.577921 run patchelf(pid=13943): Terminated: ok {rc=0} 13:32:02.705956 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13940): Process ended prematurely: osmo-stp_10.42.42.5(pid=13940) [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13940)] [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 13:32:02.715715 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:32:02.744160 run osmo-hlr_10.42.42.2(pid=13937): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13937)] 13:32:02.794993 run osmo-hlr_10.42.42.2(pid=13937): stdout: | (launched: 2022-12-10_13:31:59.443407) 13:32:02.846989 run osmo-hlr_10.42.42.2(pid=13937): stderr: | [0;m[1;31m20221210133159621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133159621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133159621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133159621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133159621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133159621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133159633 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133159642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133159642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133159642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:02.899493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13936): Terminating (SIGTERM) 13:32:02.941453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13939): Terminating (SIGTERM) 13:32:02.983507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13942): Terminating (SIGTERM) 13:32:03.026353 --- ParallelTerminationStrategy: PID 13936 died... 13:32:03.046396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13936): Terminated: ok {rc=0} 13:32:03.093700 --- ParallelTerminationStrategy: PID 13939 died... 13:32:03.113206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13939): Terminated: ok {rc=0} 13:32:03.160125 --- ParallelTerminationStrategy: PID 13942 died... 13:32:03.179650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13942): Terminated: ok {rc=0} 13:32:03.267764 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:32:04.568266 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:32:04.575457 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:32:04.611107 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:32:04.649931 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:32:04.737281 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:32:04.770742 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:32:04.809783 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:32:05.405443 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:32:05.456489 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:05.467736 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:32:05.538256 tst cs_paging_gprs_active.py: using LAC 28735 13:32:05.668148 tst cs_paging_gprs_active.py: using RAC 175 13:32:05.796004 tst cs_paging_gprs_active.py: using CellId 28735 13:32:05.921195 tst cs_paging_gprs_active.py: using BVCI 28736 13:32:06.038124 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:06.049293 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:06.060270 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:06.071290 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:06.082212 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:06.093308 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:06.104353 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:06.115260 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:06.126379 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:32:06.242166 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:32:06.361689 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:32:06.578228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:06.900305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13947): Launched 13:32:07.178581 run iperf3-srv_10.42.42.10(pid=13948): Launched 13:32:07.297928 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:32:07.513381 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:07.834515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13949): Launched 13:32:08.112597 run iperf3-srv_10.42.42.10(pid=13950): Launched 13:32:08.232081 tst cs_paging_gprs_active.py:38: start network... 13:32:08.447301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:08.943678 run create_hlr_db(pid=13951): Launched 13:32:09.072808 bus /gobi_6: Setting Powered False 13:32:10.136004 run create_hlr_db(pid=13951): Terminated: ok {rc=0} 13:32:10.581725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13953): Launched 13:32:10.900663 run osmo-hlr_10.42.42.2(pid=13954): Launched 13:32:11.022499 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:11.572314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13956): Launched 13:32:11.891697 run osmo-stp_10.42.42.5(pid=13957): Launched 13:32:12.013349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:32:12.565157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13959): Launched 13:32:12.687058 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:32:12.964557 run patchelf(pid=13960): Launched 13:32:13.142146 run osmo-stp_10.42.42.5(pid=13957): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13957)] 13:32:13.277444 run osmo-stp_10.42.42.5(pid=13957): stdout: | (launched: 2022-12-10_13:32:11.833732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:13.414241 run osmo-stp_10.42.42.5(pid=13957): stderr: | [0;m[38;5;43m20221210133212024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133212024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133212024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133212025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133212027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133212027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133212027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:13.552693 run osmo-stp_10.42.42.5(pid=13957): stdout: | (launched: 2022-12-10_13:32:11.833732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:13.684245 run osmo-stp_10.42.42.5(pid=13957): stderr: | [0;m[38;5;43m20221210133212024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133212024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133212024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133212025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133212027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133212027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133212027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:13.840318 run patchelf(pid=13960): Terminating (SIGINT) 13:32:14.020026 run patchelf(pid=13960): Terminated: ok {rc=0} 13:32:14.149773 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13957): Process ended prematurely: osmo-stp_10.42.42.5(pid=13957) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13957)] [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:32:14.159778 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:32:14.188139 run osmo-hlr_10.42.42.2(pid=13954): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13954)] 13:32:14.237730 run osmo-hlr_10.42.42.2(pid=13954): stdout: | (launched: 2022-12-10_13:32:10.842512) 13:32:14.288664 run osmo-hlr_10.42.42.2(pid=13954): stderr: | [0;m[1;31m20221210133211042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133211042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133211042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133211042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133211042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133211042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133211054 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133211062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133211062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133211062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:14.339962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13947): Terminating (SIGTERM) 13:32:14.381083 run iperf3-srv_10.42.42.10(pid=13948): Terminating (SIGTERM) 13:32:14.422302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13949): Terminating (SIGTERM) 13:32:14.463444 run iperf3-srv_10.42.42.10(pid=13950): Terminating (SIGTERM) 13:32:14.504257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13953): Terminating (SIGTERM) 13:32:14.545432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13956): Terminating (SIGTERM) 13:32:14.586567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13959): Terminating (SIGTERM) 13:32:14.627802 --- ParallelTerminationStrategy: PID 13947 died... 13:32:14.647467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13947): Terminated: ok {rc=0} 13:32:14.692895 --- ParallelTerminationStrategy: PID 13948 died... 13:32:14.712218 run iperf3-srv_10.42.42.10(pid=13948): Terminated {rc=256} 13:32:14.757673 --- ParallelTerminationStrategy: PID 13949 died... 13:32:14.777099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13949): Terminated: ok {rc=0} 13:32:14.822926 --- ParallelTerminationStrategy: PID 13950 died... 13:32:14.842061 run iperf3-srv_10.42.42.10(pid=13950): Terminated {rc=256} 13:32:14.887141 --- ParallelTerminationStrategy: PID 13953 died... 13:32:14.906361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13953): Terminated: ok {rc=0} 13:32:14.951450 --- ParallelTerminationStrategy: PID 13956 died... 13:32:14.970642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13956): Terminated: ok {rc=0} 13:32:15.015813 --- ParallelTerminationStrategy: PID 13959 died... 13:32:15.035063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13959): Terminated: ok {rc=0} 13:32:15.121197 bus /gobi_0: Setting Powered False 13:32:16.217108 bus /gobi_0: Setting Powered False 13:32:17.333647 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:32:18.478203 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:18.489523 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:32:18.558238 tst iperf3.py: using LAC 28736 13:32:18.679656 tst iperf3.py: using RAC 176 13:32:18.800394 tst iperf3.py: using CellId 28736 13:32:18.919643 tst iperf3.py: using BVCI 28737 13:32:19.029625 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:19.040206 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:19.050739 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:19.061507 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:19.072094 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:19.082925 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:19.093810 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:19.104563 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:19.115689 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:32:19.230226 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:32:19.432341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:19.734800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13961): Launched 13:32:19.995855 run iperf3-srv_10.42.42.10(pid=13962): Launched 13:32:20.109192 tst iperf3.py:8: start network... 13:32:20.311305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:20.778455 run create_hlr_db(pid=13963): Launched 13:32:20.893169 bus /gobi_6: Setting Powered False 13:32:21.953359 run create_hlr_db(pid=13963): Terminated: ok {rc=0} 13:32:22.390940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13965): Launched 13:32:22.710774 run osmo-hlr_10.42.42.2(pid=13966): Launched 13:32:22.834219 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:23.390757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13968): Launched 13:32:23.710956 run osmo-stp_10.42.42.5(pid=13969): Launched 13:32:23.836157 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:32:24.388707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13971): Launched 13:32:24.510518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:32:24.781159 run patchelf(pid=13972): Launched 13:32:24.958150 run osmo-stp_10.42.42.5(pid=13969): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13969)] 13:32:25.093332 run osmo-stp_10.42.42.5(pid=13969): stdout: | (launched: 2022-12-10_13:32:23.652610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:25.230426 run osmo-stp_10.42.42.5(pid=13969): stderr: | [0;m[38;5;43m20221210133223843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133223843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133223843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133223844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133223846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133223846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133223846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:25.367595 run osmo-stp_10.42.42.5(pid=13969): stdout: | (launched: 2022-12-10_13:32:23.652610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:25.499101 run osmo-stp_10.42.42.5(pid=13969): stderr: | [0;m[38;5;43m20221210133223843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133223843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133223843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133223844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133223846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133223846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133223846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:25.655193 run patchelf(pid=13972): Terminating (SIGINT) 13:32:25.835961 run patchelf(pid=13972): Terminated: ok {rc=0} 13:32:25.965369 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13969): Process ended prematurely: osmo-stp_10.42.42.5(pid=13969) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13969)] [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 13:32:25.975169 tst iperf3.py:8: Test FAILED (7.5 sec) 13:32:26.003472 run osmo-hlr_10.42.42.2(pid=13966): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13966)] 13:32:26.052837 run osmo-hlr_10.42.42.2(pid=13966): stdout: | (launched: 2022-12-10_13:32:22.652647) 13:32:26.103753 run osmo-hlr_10.42.42.2(pid=13966): stderr: | [0;m[1;31m20221210133222852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133222852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133222852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133222852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133222852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133222852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133222865 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133222873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133222873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133222873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:26.155117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13961): Terminating (SIGTERM) 13:32:26.196821 run iperf3-srv_10.42.42.10(pid=13962): Terminating (SIGTERM) 13:32:26.238579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13965): Terminating (SIGTERM) 13:32:26.279760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13968): Terminating (SIGTERM) 13:32:26.321157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13971): Terminating (SIGTERM) 13:32:26.362710 --- ParallelTerminationStrategy: PID 13961 died... 13:32:26.382509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13961): Terminated: ok {rc=0} 13:32:26.428011 --- ParallelTerminationStrategy: PID 13962 died... 13:32:26.447252 run iperf3-srv_10.42.42.10(pid=13962): Terminated {rc=256} 13:32:26.492467 --- ParallelTerminationStrategy: PID 13965 died... 13:32:26.511764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13965): Terminated: ok {rc=0} 13:32:26.557183 --- ParallelTerminationStrategy: PID 13968 died... 13:32:26.576436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13968): Terminated: ok {rc=0} 13:32:26.622190 --- ParallelTerminationStrategy: PID 13971 died... 13:32:26.641759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13971): Terminated: ok {rc=0} 13:32:26.729946 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:32:27.879296 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:27.890694 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:32:27.958670 tst iperf3m4.py: using LAC 28737 13:32:28.077289 tst iperf3m4.py: using RAC 177 13:32:28.201656 tst iperf3m4.py: using CellId 28737 13:32:28.319971 tst iperf3m4.py: using BVCI 28738 13:32:28.430093 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:28.440843 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:28.451391 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:28.462236 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:28.473021 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:28.483735 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:28.494586 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:28.505120 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:28.516083 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:32:28.630799 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:32:28.753810 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:32:28.871320 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:32:28.986557 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:32:29.188681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:29.490459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13973): Launched 13:32:29.753387 run iperf3-srv_10.42.42.10(pid=13974): Launched 13:32:29.867315 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:32:30.069688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:30.372868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13975): Launched 13:32:30.634444 run iperf3-srv_10.42.42.10(pid=13976): Launched 13:32:30.747319 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:32:30.963798 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:31.310103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13977): Launched 13:32:31.601721 run iperf3-srv_10.42.42.10(pid=13978): Launched 13:32:31.727655 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:32:31.934721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:32.251417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13979): Launched 13:32:32.515460 run iperf3-srv_10.42.42.10(pid=13980): Launched 13:32:32.628080 tst iperf3m4.py:8: start network... 13:32:32.829741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:33.295700 run create_hlr_db(pid=13981): Launched 13:32:33.410644 bus /gobi_6: Setting Powered False 13:32:34.470639 run create_hlr_db(pid=13981): Terminated: ok {rc=0} 13:32:34.908387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13983): Launched 13:32:35.228144 run osmo-hlr_10.42.42.2(pid=13984): Launched 13:32:35.351752 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:35.908766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13986): Launched 13:32:36.217203 run osmo-stp_10.42.42.5(pid=13990): Launched 13:32:36.332430 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:32:36.850541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13992): Launched 13:32:36.964612 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:32:37.217581 run patchelf(pid=13993): Launched 13:32:37.384411 run osmo-stp_10.42.42.5(pid=13990): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13990)] 13:32:37.511868 run osmo-stp_10.42.42.5(pid=13990): stdout: | (launched: 2022-12-10_13:32:36.162087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:37.640622 run osmo-stp_10.42.42.5(pid=13990): stderr: | [0;m[38;5;43m20221210133236328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133236329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133236329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133236329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133236331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133236332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133236332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:37.769787 run osmo-stp_10.42.42.5(pid=13990): stdout: | (launched: 2022-12-10_13:32:36.162087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:37.893713 run osmo-stp_10.42.42.5(pid=13990): stderr: | [0;m[38;5;43m20221210133236328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133236329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133236329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133236329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133236331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133236332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133236332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:38.040422 run patchelf(pid=13993): Terminating (SIGINT) 13:32:38.209971 run patchelf(pid=13993): Terminated: ok {rc=0} 13:32:38.331985 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13990): Process ended prematurely: osmo-stp_10.42.42.5(pid=13990) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13990)] [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:32:38.341386 tst iperf3m4.py:8: Test FAILED (10.5 sec) 13:32:38.368844 run osmo-hlr_10.42.42.2(pid=13984): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13984)] 13:32:38.416385 run osmo-hlr_10.42.42.2(pid=13984): stdout: | (launched: 2022-12-10_13:32:35.169855) 13:32:38.465323 run osmo-hlr_10.42.42.2(pid=13984): stderr: | [0;m[1;31m20221210133235370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133235370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133235370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133235370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133235370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133235370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133235382 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133235391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133235391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133235391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:38.514603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13973): Terminating (SIGTERM) 13:32:38.554087 run iperf3-srv_10.42.42.10(pid=13974): Terminating (SIGTERM) 13:32:38.593527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13975): Terminating (SIGTERM) 13:32:38.632921 run iperf3-srv_10.42.42.10(pid=13976): Terminating (SIGTERM) 13:32:38.672229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13977): Terminating (SIGTERM) 13:32:38.711941 run iperf3-srv_10.42.42.10(pid=13978): Terminating (SIGTERM) 13:32:38.751242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13979): Terminating (SIGTERM) 13:32:38.790822 run iperf3-srv_10.42.42.10(pid=13980): Terminating (SIGTERM) 13:32:38.830248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13983): Terminating (SIGTERM) 13:32:38.869613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13986): Terminating (SIGTERM) 13:32:38.908862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13992): Terminating (SIGTERM) 13:32:38.948616 --- ParallelTerminationStrategy: PID 13973 died... 13:32:38.967520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13973): Terminated: ok {rc=0} 13:32:39.011902 --- ParallelTerminationStrategy: PID 13974 died... 13:32:39.030312 run iperf3-srv_10.42.42.10(pid=13974): Terminated {rc=256} 13:32:39.073978 --- ParallelTerminationStrategy: PID 13975 died... 13:32:39.092359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13975): Terminated: ok {rc=0} 13:32:39.136426 --- ParallelTerminationStrategy: PID 13976 died... 13:32:39.154787 run iperf3-srv_10.42.42.10(pid=13976): Terminated {rc=256} 13:32:39.199035 --- ParallelTerminationStrategy: PID 13977 died... 13:32:39.217488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13977): Terminated: ok {rc=0} 13:32:39.261596 --- ParallelTerminationStrategy: PID 13978 died... 13:32:39.279855 run iperf3-srv_10.42.42.10(pid=13978): Terminated {rc=256} 13:32:39.323585 --- ParallelTerminationStrategy: PID 13979 died... 13:32:39.342082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13979): Terminated: ok {rc=0} 13:32:39.386314 --- ParallelTerminationStrategy: PID 13980 died... 13:32:39.404722 run iperf3-srv_10.42.42.10(pid=13980): Terminated {rc=256} 13:32:39.448573 --- ParallelTerminationStrategy: PID 13983 died... 13:32:39.467022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13983): Terminated: ok {rc=0} 13:32:39.510851 --- ParallelTerminationStrategy: PID 13986 died... 13:32:39.529343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13986): Terminated: ok {rc=0} 13:32:39.573332 --- ParallelTerminationStrategy: PID 13992 died... 13:32:39.591672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13992): Terminated: ok {rc=0} 13:32:39.677531 bus /gobi_4: Setting Powered False 13:32:40.776316 bus /gobi_4: Setting Powered False 13:32:41.891842 bus /gobi_1: Setting Powered False 13:32:42.992287 bus /gobi_1: Setting Powered False 13:32:44.107650 bus /gobi_0: Setting Powered False 13:32:45.205538 bus /gobi_0: Setting Powered False 13:32:46.323891 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:32:47.436784 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:47.448734 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:32:47.523043 tst ping.py: using LAC 28738 13:32:47.648095 tst ping.py: using RAC 178 13:32:47.770606 tst ping.py: using CellId 28738 13:32:47.893297 tst ping.py: using BVCI 28739 13:32:48.007997 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:48.019292 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:48.030339 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:48.041381 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:48.052250 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:48.063202 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:48.074482 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:48.085627 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:32:48.198821 tst ping.py:19: start network... 13:32:48.397368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:48.855601 run create_hlr_db(pid=13994): Launched 13:32:48.976569 bus /gobi_6: Setting Powered False 13:32:50.039291 run create_hlr_db(pid=13994): Terminated: ok {rc=0} 13:32:50.461129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13996): Launched 13:32:50.777381 run osmo-hlr_10.42.42.2(pid=13997): Launched 13:32:50.896890 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:51.444319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13999): Launched 13:32:51.759118 run osmo-stp_10.42.42.5(pid=14000): Launched 13:32:51.879766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:32:52.420464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14002): Launched 13:32:52.540184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:32:52.806194 run patchelf(pid=14003): Launched 13:32:52.980845 run osmo-stp_10.42.42.5(pid=14000): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14000)] 13:32:53.114209 run osmo-stp_10.42.42.5(pid=14000): stdout: | (launched: 2022-12-10_13:32:51.701309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:53.249109 run osmo-stp_10.42.42.5(pid=14000): stderr: | [0;m[38;5;43m20221210133251892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133251893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133251893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133251893 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133251894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133251894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133251894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:53.383638 run osmo-stp_10.42.42.5(pid=14000): stdout: | (launched: 2022-12-10_13:32:51.701309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:53.512890 run osmo-stp_10.42.42.5(pid=14000): stderr: | [0;m[38;5;43m20221210133251892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133251893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133251893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133251893 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133251894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133251894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133251894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:53.665912 run patchelf(pid=14003): Terminating (SIGINT) 13:32:53.843284 run patchelf(pid=14003): Terminated: ok {rc=0} 13:32:53.970935 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14000): Process ended prematurely: osmo-stp_10.42.42.5(pid=14000) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14000)] [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 13:32:53.980434 tst ping.py:22: Test FAILED (6.5 sec) 13:32:54.008591 run osmo-hlr_10.42.42.2(pid=13997): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13997)] 13:32:54.058487 run osmo-hlr_10.42.42.2(pid=13997): stdout: | (launched: 2022-12-10_13:32:50.719693) 13:32:54.110164 run osmo-hlr_10.42.42.2(pid=13997): stderr: | [0;m[1;31m20221210133250916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133250916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133250916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133250916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133250916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133250916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133250930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133250938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133250938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133250938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:54.162081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13996): Terminating (SIGTERM) 13:32:54.203882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13999): Terminating (SIGTERM) 13:32:54.245588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14002): Terminating (SIGTERM) 13:32:54.287532 --- ParallelTerminationStrategy: PID 13996 died... 13:32:54.307122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13996): Terminated: ok {rc=0} 13:32:54.353603 --- ParallelTerminationStrategy: PID 13999 died... 13:32:54.373138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13999): Terminated: ok {rc=0} 13:32:54.419157 --- ParallelTerminationStrategy: PID 14002 died... 13:32:54.438771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14002): Terminated: ok {rc=0} 13:32:54.524919 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:32:55.612296 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:55.624007 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:32:55.695438 tst ping_idle_ping.py: using LAC 28739 13:32:55.812836 tst ping_idle_ping.py: using RAC 179 13:32:55.930365 tst ping_idle_ping.py: using CellId 28739 13:32:56.053649 tst ping_idle_ping.py: using BVCI 28740 13:32:56.162771 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:56.173767 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:56.184429 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:56.195352 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:56.206201 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:56.217038 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:56.228020 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:32:56.238902 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:32:56.357397 tst ping_idle_ping.py:24: start network... 13:32:56.569892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:57.062135 run create_hlr_db(pid=14004): Launched 13:32:57.182765 bus /gobi_6: Setting Powered False 13:32:58.245876 run create_hlr_db(pid=14004): Terminated: ok {rc=0} 13:32:58.669906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14006): Launched 13:32:58.964795 run osmo-hlr_10.42.42.2(pid=14007): Launched 13:32:59.077251 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:59.586476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14009): Launched 13:32:59.880885 run osmo-stp_10.42.42.5(pid=14010): Launched 13:32:59.993302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:00.502209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14012): Launched 13:33:00.615082 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:00.897688 run patchelf(pid=14013): Launched 13:33:01.087485 run osmo-stp_10.42.42.5(pid=14010): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14010)] 13:33:01.228806 run osmo-stp_10.42.42.5(pid=14010): stdout: | (launched: 2022-12-10_13:32:59.826557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:01.371299 run osmo-stp_10.42.42.5(pid=14010): stderr: | [0;m[38;5;43m20221210133259996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133259996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133259996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133259997 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133259999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133259999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133259999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:01.512048 run osmo-stp_10.42.42.5(pid=14010): stdout: | (launched: 2022-12-10_13:32:59.826557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:01.650338 run osmo-stp_10.42.42.5(pid=14010): stderr: | [0;m[38;5;43m20221210133259996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133259996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133259996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133259997 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133259999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133259999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133259999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:01.812039 run patchelf(pid=14013): Terminating (SIGINT) 13:33:01.998042 run patchelf(pid=14013): Terminated: ok {rc=0} 13:33:02.130520 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14010): Process ended prematurely: osmo-stp_10.42.42.5(pid=14010) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14010)] [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:33:02.141162 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:33:02.172163 run osmo-hlr_10.42.42.2(pid=14007): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14007)] 13:33:02.222861 run osmo-hlr_10.42.42.2(pid=14007): stdout: | (launched: 2022-12-10_13:32:58.910460) 13:33:02.275622 run osmo-hlr_10.42.42.2(pid=14007): stderr: | [0;m[1;31m20221210133259087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133259087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133259087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133259087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133259087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133259087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133259100 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133259108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133259108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133259108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:02.328583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14006): Terminating (SIGTERM) 13:33:02.371573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14009): Terminating (SIGTERM) 13:33:02.414229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14012): Terminating (SIGTERM) 13:33:02.457055 --- ParallelTerminationStrategy: PID 14006 died... 13:33:02.477154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14006): Terminated: ok {rc=0} 13:33:02.524645 --- ParallelTerminationStrategy: PID 14009 died... 13:33:02.544493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14009): Terminated: ok {rc=0} 13:33:02.591604 --- ParallelTerminationStrategy: PID 14012 died... 13:33:02.611367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14012): Terminated: ok {rc=0} 13:33:02.699025 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:33:04.002952 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:33:04.009585 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:33:04.045547 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:33:04.085313 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:33:04.172525 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:33:04.206820 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:33:04.246345 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:33:04.840011 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:33:04.893460 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:04.904532 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:33:04.974143 tst cs_paging_gprs_active.py: using LAC 28740 13:33:05.101429 tst cs_paging_gprs_active.py: using RAC 180 13:33:05.228174 tst cs_paging_gprs_active.py: using CellId 28740 13:33:05.353947 tst cs_paging_gprs_active.py: using BVCI 28741 13:33:05.471588 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:05.482854 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:05.493868 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:05.505060 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:05.516129 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:05.527563 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:05.539010 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:05.550125 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:05.561494 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:33:05.680515 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:33:05.803524 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:33:06.006169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:06.308218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14018): Launched 13:33:06.571263 run iperf3-srv_10.42.42.10(pid=14019): Launched 13:33:06.684757 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:33:06.886526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:07.187734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14020): Launched 13:33:07.449193 run iperf3-srv_10.42.42.10(pid=14021): Launched 13:33:07.562035 tst cs_paging_gprs_active.py:38: start network... 13:33:07.763251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:08.230410 run create_hlr_db(pid=14022): Launched 13:33:08.354124 bus /gobi_6: Setting Powered False 13:33:09.413801 run create_hlr_db(pid=14022): Terminated: ok {rc=0} 13:33:09.852308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14024): Launched 13:33:10.173201 run osmo-hlr_10.42.42.2(pid=14025): Launched 13:33:10.297115 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:10.852710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14027): Launched 13:33:11.172909 run osmo-stp_10.42.42.5(pid=14028): Launched 13:33:11.295421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:11.852201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14030): Launched 13:33:11.975317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:12.247629 run patchelf(pid=14031): Launched 13:33:12.427391 run osmo-stp_10.42.42.5(pid=14028): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14028)] 13:33:12.563226 run osmo-stp_10.42.42.5(pid=14028): stdout: | (launched: 2022-12-10_13:33:11.114336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:12.700352 run osmo-stp_10.42.42.5(pid=14028): stderr: | [0;m[38;5;43m20221210133311304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133311305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133311305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133311305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133311306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133311306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133311306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:12.838530 run osmo-stp_10.42.42.5(pid=14028): stdout: | (launched: 2022-12-10_13:33:11.114336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:12.970249 run osmo-stp_10.42.42.5(pid=14028): stderr: | [0;m[38;5;43m20221210133311304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133311305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133311305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133311305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133311306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133311306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133311306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:13.126619 run patchelf(pid=14031): Terminating (SIGINT) 13:33:13.306534 run patchelf(pid=14031): Terminated: ok {rc=0} 13:33:13.436097 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14028): Process ended prematurely: osmo-stp_10.42.42.5(pid=14028) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14028)] [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:33:13.446178 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:33:13.474907 run osmo-hlr_10.42.42.2(pid=14025): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14025)] 13:33:13.524583 run osmo-hlr_10.42.42.2(pid=14025): stdout: | (launched: 2022-12-10_13:33:10.114879) 13:33:13.576386 run osmo-hlr_10.42.42.2(pid=14025): stderr: | [0;m[1;31m20221210133310312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133310312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133310312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133310312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133310312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133310312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133310325 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133310333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133310334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133310334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:13.628672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14018): Terminating (SIGTERM) 13:33:13.670404 run iperf3-srv_10.42.42.10(pid=14019): Terminating (SIGTERM) 13:33:13.711949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14020): Terminating (SIGTERM) 13:33:13.753988 run iperf3-srv_10.42.42.10(pid=14021): Terminating (SIGTERM) 13:33:13.795452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14024): Terminating (SIGTERM) 13:33:13.836994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14027): Terminating (SIGTERM) 13:33:13.878478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14030): Terminating (SIGTERM) 13:33:13.920282 --- ParallelTerminationStrategy: PID 14018 died... 13:33:13.940120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14018): Terminated: ok {rc=0} 13:33:13.986513 --- ParallelTerminationStrategy: PID 14019 died... 13:33:14.005742 run iperf3-srv_10.42.42.10(pid=14019): Terminated {rc=256} 13:33:14.052078 --- ParallelTerminationStrategy: PID 14020 died... 13:33:14.071574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14020): Terminated: ok {rc=0} 13:33:14.117658 --- ParallelTerminationStrategy: PID 14021 died... 13:33:14.136936 run iperf3-srv_10.42.42.10(pid=14021): Terminated {rc=256} 13:33:14.182928 --- ParallelTerminationStrategy: PID 14024 died... 13:33:14.202341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14024): Terminated: ok {rc=0} 13:33:14.248082 --- ParallelTerminationStrategy: PID 14027 died... 13:33:14.267348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14027): Terminated: ok {rc=0} 13:33:14.313352 --- ParallelTerminationStrategy: PID 14030 died... 13:33:14.332466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14030): Terminated: ok {rc=0} 13:33:14.419308 bus /gobi_0: Setting Powered False 13:33:15.517515 bus /gobi_0: Setting Powered False 13:33:16.637792 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:33:17.789679 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:17.801512 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:33:17.876797 tst iperf3.py: using LAC 28741 13:33:18.002842 tst iperf3.py: using RAC 181 13:33:18.129165 tst iperf3.py: using CellId 28741 13:33:18.253776 tst iperf3.py: using BVCI 28742 13:33:18.370963 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:18.382243 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:18.393210 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:18.404550 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:18.415744 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:18.427093 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:18.438484 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:18.449569 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:18.461057 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:33:18.576545 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:33:18.778047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:19.078600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14032): Launched 13:33:19.339056 run iperf3-srv_10.42.42.10(pid=14033): Launched 13:33:19.452029 tst iperf3.py:8: start network... 13:33:19.653283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:20.119396 run create_hlr_db(pid=14034): Launched 13:33:20.242534 bus /gobi_6: Setting Powered False 13:33:21.302597 run create_hlr_db(pid=14034): Terminated: ok {rc=0} 13:33:21.741193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14036): Launched 13:33:22.060822 run osmo-hlr_10.42.42.2(pid=14037): Launched 13:33:22.183836 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:22.742523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14039): Launched 13:33:23.063534 run osmo-stp_10.42.42.5(pid=14040): Launched 13:33:23.186378 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:23.741722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14042): Launched 13:33:23.865257 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:24.137269 run patchelf(pid=14043): Launched 13:33:24.314833 run osmo-stp_10.42.42.5(pid=14040): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14040)] 13:33:24.450346 run osmo-stp_10.42.42.5(pid=14040): stdout: | (launched: 2022-12-10_13:33:23.004771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:24.587510 run osmo-stp_10.42.42.5(pid=14040): stderr: | [0;m[38;5;43m20221210133323197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133323197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133323198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133323198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133323198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133323199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133323199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:24.724482 run osmo-stp_10.42.42.5(pid=14040): stdout: | (launched: 2022-12-10_13:33:23.004771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:24.856427 run osmo-stp_10.42.42.5(pid=14040): stderr: | [0;m[38;5;43m20221210133323197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133323197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133323198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133323198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133323198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133323199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133323199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:25.011956 run patchelf(pid=14043): Terminating (SIGINT) 13:33:25.191887 run patchelf(pid=14043): Terminated: ok {rc=0} 13:33:25.321785 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14040): Process ended prematurely: osmo-stp_10.42.42.5(pid=14040) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14040)] [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 13:33:25.331850 tst iperf3.py:8: Test FAILED (7.6 sec) 13:33:25.360891 run osmo-hlr_10.42.42.2(pid=14037): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14037)] 13:33:25.411345 run osmo-hlr_10.42.42.2(pid=14037): stdout: | (launched: 2022-12-10_13:33:22.002583) 13:33:25.463254 run osmo-hlr_10.42.42.2(pid=14037): stderr: | [0;m[1;31m20221210133322203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133322203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133322203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133322203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133322203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133322203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133322216 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133322226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133322226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133322226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:25.515753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14032): Terminating (SIGTERM) 13:33:25.558406 run iperf3-srv_10.42.42.10(pid=14033): Terminating (SIGTERM) 13:33:25.600614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14036): Terminating (SIGTERM) 13:33:25.642758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14039): Terminating (SIGTERM) 13:33:25.685238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14042): Terminating (SIGTERM) 13:33:25.727600 --- ParallelTerminationStrategy: PID 14032 died... 13:33:25.747860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14032): Terminated: ok {rc=0} 13:33:25.794326 --- ParallelTerminationStrategy: PID 14033 died... 13:33:25.813913 run iperf3-srv_10.42.42.10(pid=14033): Terminated {rc=256} 13:33:25.860424 --- ParallelTerminationStrategy: PID 14036 died... 13:33:25.879892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14036): Terminated: ok {rc=0} 13:33:25.926162 --- ParallelTerminationStrategy: PID 14039 died... 13:33:25.945637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14039): Terminated: ok {rc=0} 13:33:25.992120 --- ParallelTerminationStrategy: PID 14042 died... 13:33:26.011658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14042): Terminated: ok {rc=0} 13:33:26.099434 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:33:27.247580 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:27.259401 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:33:27.330734 tst iperf3m4.py: using LAC 28742 13:33:27.459479 tst iperf3m4.py: using RAC 182 13:33:27.585470 tst iperf3m4.py: using CellId 28742 13:33:27.712734 tst iperf3m4.py: using BVCI 28743 13:33:27.830159 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:27.841413 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:27.852350 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:27.863741 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:27.874948 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:27.886513 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:27.897853 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:27.909110 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:27.920363 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:33:28.039627 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:33:28.158921 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:33:28.273915 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:33:28.394820 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:33:28.610814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:28.933144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14044): Launched 13:33:29.211732 run iperf3-srv_10.42.42.10(pid=14045): Launched 13:33:29.332067 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:33:29.547692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:29.869320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14046): Launched 13:33:30.148517 run iperf3-srv_10.42.42.10(pid=14047): Launched 13:33:30.269688 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:33:30.486230 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:30.808670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14048): Launched 13:33:31.095190 run iperf3-srv_10.42.42.10(pid=14049): Launched 13:33:31.230293 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:33:31.450644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:31.776095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14050): Launched 13:33:32.057969 run iperf3-srv_10.42.42.10(pid=14051): Launched 13:33:32.188579 tst iperf3m4.py:8: start network... 13:33:32.390046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:32.857088 run create_hlr_db(pid=14052): Launched 13:33:32.979445 bus /gobi_6: Setting Powered False 13:33:34.039080 run create_hlr_db(pid=14052): Terminated: ok {rc=0} 13:33:34.475922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14054): Launched 13:33:34.795970 run osmo-hlr_10.42.42.2(pid=14055): Launched 13:33:34.918584 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:35.473641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14057): Launched 13:33:35.794237 run osmo-stp_10.42.42.5(pid=14058): Launched 13:33:35.916247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:36.469440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14060): Launched 13:33:36.591868 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:36.863026 run patchelf(pid=14061): Launched 13:33:37.039937 run osmo-stp_10.42.42.5(pid=14058): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14058)] 13:33:37.174982 run osmo-stp_10.42.42.5(pid=14058): stdout: | (launched: 2022-12-10_13:33:35.735139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:37.311672 run osmo-stp_10.42.42.5(pid=14058): stderr: | [0;m[38;5;43m20221210133335927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133335927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133335927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133335928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133335928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133335928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133335929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:37.449401 run osmo-stp_10.42.42.5(pid=14058): stdout: | (launched: 2022-12-10_13:33:35.735139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:37.580911 run osmo-stp_10.42.42.5(pid=14058): stderr: | [0;m[38;5;43m20221210133335927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133335927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133335927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133335928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133335928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133335928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133335929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:37.736447 run patchelf(pid=14061): Terminating (SIGINT) 13:33:37.916517 run patchelf(pid=14061): Terminated: ok {rc=0} 13:33:38.046305 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14058): Process ended prematurely: osmo-stp_10.42.42.5(pid=14058) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14058)] [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:33:38.056208 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:33:38.085672 run osmo-hlr_10.42.42.2(pid=14055): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14055)] 13:33:38.135863 run osmo-hlr_10.42.42.2(pid=14055): stdout: | (launched: 2022-12-10_13:33:34.737206) 13:33:38.187325 run osmo-hlr_10.42.42.2(pid=14055): stderr: | [0;m[1;31m20221210133334934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133334934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133334934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133334935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133334935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133334935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133334946 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133334954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133334954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133334954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:38.239419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14044): Terminating (SIGTERM) 13:33:38.281181 run iperf3-srv_10.42.42.10(pid=14045): Terminating (SIGTERM) 13:33:38.323117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14046): Terminating (SIGTERM) 13:33:38.364923 run iperf3-srv_10.42.42.10(pid=14047): Terminating (SIGTERM) 13:33:38.406465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14048): Terminating (SIGTERM) 13:33:38.448181 run iperf3-srv_10.42.42.10(pid=14049): Terminating (SIGTERM) 13:33:38.489609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14050): Terminating (SIGTERM) 13:33:38.531507 run iperf3-srv_10.42.42.10(pid=14051): Terminating (SIGTERM) 13:33:38.573061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14054): Terminating (SIGTERM) 13:33:38.614682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14057): Terminating (SIGTERM) 13:33:38.656296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14060): Terminating (SIGTERM) 13:33:38.698563 --- ParallelTerminationStrategy: PID 14044 died... 13:33:38.718555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14044): Terminated: ok {rc=0} 13:33:38.765669 --- ParallelTerminationStrategy: PID 14045 died... 13:33:38.785548 run iperf3-srv_10.42.42.10(pid=14045): Terminated {rc=256} 13:33:38.831973 --- ParallelTerminationStrategy: PID 14046 died... 13:33:38.851297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14046): Terminated: ok {rc=0} 13:33:38.897703 --- ParallelTerminationStrategy: PID 14047 died... 13:33:38.917205 run iperf3-srv_10.42.42.10(pid=14047): Terminated {rc=256} 13:33:38.963563 --- ParallelTerminationStrategy: PID 14048 died... 13:33:38.982984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14048): Terminated: ok {rc=0} 13:33:39.029552 --- ParallelTerminationStrategy: PID 14049 died... 13:33:39.049077 run iperf3-srv_10.42.42.10(pid=14049): Terminated {rc=256} 13:33:39.095248 --- ParallelTerminationStrategy: PID 14050 died... 13:33:39.114713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14050): Terminated: ok {rc=0} 13:33:39.161259 --- ParallelTerminationStrategy: PID 14051 died... 13:33:39.180521 run iperf3-srv_10.42.42.10(pid=14051): Terminated {rc=256} 13:33:39.226940 --- ParallelTerminationStrategy: PID 14054 died... 13:33:39.246440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14054): Terminated: ok {rc=0} 13:33:39.292649 --- ParallelTerminationStrategy: PID 14057 died... 13:33:39.312254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14057): Terminated: ok {rc=0} 13:33:39.358587 --- ParallelTerminationStrategy: PID 14060 died... 13:33:39.378208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14060): Terminated: ok {rc=0} 13:33:39.466783 bus /gobi_4: Setting Powered False 13:33:40.562994 bus /gobi_4: Setting Powered False 13:33:41.678354 bus /gobi_1: Setting Powered False 13:33:42.776751 bus /gobi_1: Setting Powered False 13:33:43.888349 bus /gobi_0: Setting Powered False 13:33:44.985311 bus /gobi_0: Setting Powered False 13:33:46.125004 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:33:47.252370 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:47.265267 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:33:47.336775 tst ping.py: using LAC 28743 13:33:47.462715 tst ping.py: using RAC 183 13:33:47.591820 tst ping.py: using CellId 28743 13:33:47.714666 tst ping.py: using BVCI 28744 13:33:47.829911 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:47.841188 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:47.852117 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:47.863336 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:47.874766 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:47.886036 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:47.897427 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:47.908519 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:33:48.025502 tst ping.py:19: start network... 13:33:48.223062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:48.679979 run create_hlr_db(pid=14062): Launched 13:33:48.800843 bus /gobi_6: Setting Powered False 13:33:49.859924 run create_hlr_db(pid=14062): Terminated: ok {rc=0} 13:33:50.297167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14064): Launched 13:33:50.613144 run osmo-hlr_10.42.42.2(pid=14065): Launched 13:33:50.733917 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:51.283451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14067): Launched 13:33:51.598311 run osmo-stp_10.42.42.5(pid=14068): Launched 13:33:51.718815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:52.264267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14070): Launched 13:33:52.385696 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:52.652248 run patchelf(pid=14071): Launched 13:33:52.828822 run osmo-stp_10.42.42.5(pid=14068): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14068)] 13:33:52.962564 run osmo-stp_10.42.42.5(pid=14068): stdout: | (launched: 2022-12-10_13:33:51.540102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:53.097635 run osmo-stp_10.42.42.5(pid=14068): stderr: | [0;m[38;5;43m20221210133351731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133351731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133351732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133351732 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133351732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133351732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133351733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:53.233158 run osmo-stp_10.42.42.5(pid=14068): stdout: | (launched: 2022-12-10_13:33:51.540102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:53.362912 run osmo-stp_10.42.42.5(pid=14068): stderr: | [0;m[38;5;43m20221210133351731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133351731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133351732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133351732 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133351732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133351732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133351733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:53.516747 run patchelf(pid=14071): Terminating (SIGINT) 13:33:53.694713 run patchelf(pid=14071): Terminated: ok {rc=0} 13:33:53.823196 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14068): Process ended prematurely: osmo-stp_10.42.42.5(pid=14068) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14068)] [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 13:33:53.832361 tst ping.py:22: Test FAILED (6.6 sec) 13:33:53.860818 run osmo-hlr_10.42.42.2(pid=14065): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14065)] 13:33:53.910859 run osmo-hlr_10.42.42.2(pid=14065): stdout: | (launched: 2022-12-10_13:33:50.555581) 13:33:53.962451 run osmo-hlr_10.42.42.2(pid=14065): stderr: | [0;m[1;31m20221210133350753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133350753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133350754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133350754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133350754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133350754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133350769 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133350779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133350779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133350779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:54.014395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14064): Terminating (SIGTERM) 13:33:54.055898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14067): Terminating (SIGTERM) 13:33:54.097415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14070): Terminating (SIGTERM) 13:33:54.139238 --- ParallelTerminationStrategy: PID 14064 died... 13:33:54.159101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14064): Terminated: ok {rc=0} 13:33:54.205285 --- ParallelTerminationStrategy: PID 14067 died... 13:33:54.224524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14067): Terminated: ok {rc=0} 13:33:54.270728 --- ParallelTerminationStrategy: PID 14070 died... 13:33:54.289989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14070): Terminated: ok {rc=0} 13:33:54.376720 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:33:55.463576 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:55.475744 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:33:55.547874 tst ping_idle_ping.py: using LAC 28744 13:33:55.672782 tst ping_idle_ping.py: using RAC 184 13:33:55.796794 tst ping_idle_ping.py: using CellId 28744 13:33:55.921492 tst ping_idle_ping.py: using BVCI 28745 13:33:56.032798 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:56.043664 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:56.054289 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:56.065813 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:56.076869 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:56.088049 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:56.099228 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:33:56.110370 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:33:56.226082 tst ping_idle_ping.py:24: start network... 13:33:56.424840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:56.887744 run create_hlr_db(pid=14072): Launched 13:33:57.009657 bus /gobi_6: Setting Powered False 13:33:58.069423 run create_hlr_db(pid=14072): Terminated: ok {rc=0} 13:33:58.502332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14074): Launched 13:33:58.819693 run osmo-hlr_10.42.42.2(pid=14075): Launched 13:33:58.940681 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:59.489433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14077): Launched 13:33:59.806410 run osmo-stp_10.42.42.5(pid=14078): Launched 13:33:59.926876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:00.472351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14080): Launched 13:34:00.593398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:00.869846 run patchelf(pid=14081): Launched 13:34:01.064396 run osmo-stp_10.42.42.5(pid=14078): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14078)] 13:34:01.196524 run osmo-stp_10.42.42.5(pid=14078): stdout: | (launched: 2022-12-10_13:33:59.747919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:01.328380 run osmo-stp_10.42.42.5(pid=14078): stderr: | [0;m[38;5;43m20221210133359938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133359938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133359938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133359939 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133359941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133359941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133359941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:01.462384 run osmo-stp_10.42.42.5(pid=14078): stdout: | (launched: 2022-12-10_13:33:59.747919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:01.589237 run osmo-stp_10.42.42.5(pid=14078): stderr: | [0;m[38;5;43m20221210133359938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133359938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133359938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133359939 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133359941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133359941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133359941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:01.739503 run patchelf(pid=14081): Terminating (SIGINT) 13:34:01.913256 run patchelf(pid=14081): Terminated: ok {rc=0} 13:34:02.037382 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14078): Process ended prematurely: osmo-stp_10.42.42.5(pid=14078) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14078)] [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:34:02.047297 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:34:02.075365 run osmo-hlr_10.42.42.2(pid=14075): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14075)] 13:34:02.124432 run osmo-hlr_10.42.42.2(pid=14075): stdout: | (launched: 2022-12-10_13:33:58.761453) 13:34:02.175514 run osmo-hlr_10.42.42.2(pid=14075): stderr: | [0;m[1;31m20221210133358959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133358959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133358959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133358959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133358959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133358959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133358971 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133358979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133358980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133358980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:02.225191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14074): Terminating (SIGTERM) 13:34:02.265024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14077): Terminating (SIGTERM) 13:34:02.304879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14080): Terminating (SIGTERM) 13:34:02.345119 --- ParallelTerminationStrategy: PID 14074 died... 13:34:02.364251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14074): Terminated: ok {rc=0} 13:34:02.408777 --- ParallelTerminationStrategy: PID 14077 died... 13:34:02.428132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14077): Terminated: ok {rc=0} 13:34:02.472011 --- ParallelTerminationStrategy: PID 14080 died... 13:34:02.490634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14080): Terminated: ok {rc=0} 13:34:02.575741 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:34:03.880284 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:34:03.887274 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:34:03.921789 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:34:03.956702 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:34:04.010118 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:34:04.043372 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:34:04.078285 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:34:04.635900 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:34:04.642678 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:34:04.654565 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:34:04.725511 tst switch_tch_pdch.py: using LAC 28745 13:34:04.841655 tst switch_tch_pdch.py: using RAC 185 13:34:04.958117 tst switch_tch_pdch.py: using CellId 28745 13:34:05.074308 tst switch_tch_pdch.py: using BVCI 28746 13:34:05.181714 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:34:05.192650 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:34:05.203508 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:34:05.214620 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:34:05.225492 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:34:05.236219 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:34:05.247189 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:34:05.258079 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:34:05.375455 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:34:05.500628 tst switch_tch_pdch.py:51: start network... 13:34:05.712580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:06.200197 run create_hlr_db(pid=14087): Launched 13:34:06.321563 bus /gobi_6: Setting Powered False 13:34:07.381286 run create_hlr_db(pid=14087): Terminated: ok {rc=0} 13:34:07.801243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14089): Launched 13:34:08.095095 run osmo-hlr_10.42.42.2(pid=14090): Launched 13:34:08.206861 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:08.725727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14092): Launched 13:34:09.019414 run osmo-stp_10.42.42.5(pid=14093): Launched 13:34:09.131373 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:09.638697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14095): Launched 13:34:09.750535 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:09.999056 run patchelf(pid=14096): Launched 13:34:10.163090 run osmo-stp_10.42.42.5(pid=14093): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14093)] 13:34:10.287656 run osmo-stp_10.42.42.5(pid=14093): stdout: | (launched: 2022-12-10_13:34:08.965499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:10.413544 run osmo-stp_10.42.42.5(pid=14093): stderr: | [0;m[38;5;43m20221210133409133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133409134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133409134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133409134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133409136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133409137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133409137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:10.540110 run osmo-stp_10.42.42.5(pid=14093): stdout: | (launched: 2022-12-10_13:34:08.965499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:10.660518 run osmo-stp_10.42.42.5(pid=14093): stderr: | [0;m[38;5;43m20221210133409133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133409134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133409134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133409134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133409136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133409137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133409137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:10.803809 run patchelf(pid=14096): Terminating (SIGINT) 13:34:10.969745 run patchelf(pid=14096): Terminated: ok {rc=0} 13:34:11.089066 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14093): Process ended prematurely: osmo-stp_10.42.42.5(pid=14093) [trial-2375↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14093)] [trial-2375↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:34:11.097758 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:34:11.123969 run osmo-hlr_10.42.42.2(pid=14090): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14090)] 13:34:11.170596 run osmo-hlr_10.42.42.2(pid=14090): stdout: | (launched: 2022-12-10_13:34:08.040855) 13:34:11.218823 run osmo-hlr_10.42.42.2(pid=14090): stderr: | [0;m[1;31m20221210133408218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133408218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133408218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133408218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133408218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133408218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133408230 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133408239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133408239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133408239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:11.267791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14089): Terminating (SIGTERM) 13:34:11.306637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14092): Terminating (SIGTERM) 13:34:11.345531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14095): Terminating (SIGTERM) 13:34:11.384510 --- ParallelTerminationStrategy: PID 14089 died... 13:34:11.403256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14089): Terminated: ok {rc=0} 13:34:11.446592 --- ParallelTerminationStrategy: PID 14092 died... 13:34:11.464871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14092): Terminated: ok {rc=0} 13:34:11.507929 --- ParallelTerminationStrategy: PID 14095 died... 13:34:11.526133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14095): Terminated: ok {rc=0} 13:34:11.607353 bus /gobi_0: Setting Powered False 13:34:12.700697 bus /gobi_0: Setting Powered False 13:34:13.814717 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:34:15.060456 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:34:15.067551 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:34:15.101572 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:34:15.136654 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:34:15.191359 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:34:15.225108 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:34:15.260165 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:34:15.813507 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:34:15.818698 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:34:15.831906 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:34:15.907412 tst switch_tch_pdch.py: using LAC 28746 13:34:16.044362 tst switch_tch_pdch.py: using RAC 186 13:34:16.169824 tst switch_tch_pdch.py: using CellId 28746 13:34:16.296120 tst switch_tch_pdch.py: using BVCI 28747 13:34:16.416860 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:34:16.429521 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:34:16.442578 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:34:16.455745 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:34:16.467688 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:34:16.480899 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:34:16.495179 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:34:16.507212 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:34:16.642955 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:34:16.784471 tst switch_tch_pdch.py:51: start network... 13:34:17.033292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:17.496625 run create_hlr_db(pid=14100): Launched 13:34:17.618191 bus /gobi_6: Setting Powered False 13:34:18.681342 run create_hlr_db(pid=14100): Terminated: ok {rc=0} 13:34:19.076884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14102): Launched 13:34:19.372389 run osmo-hlr_10.42.42.2(pid=14103): Launched 13:34:19.483681 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:19.965164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14105): Launched 13:34:20.258596 run osmo-stp_10.42.42.5(pid=14106): Launched 13:34:20.370155 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:20.853937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14108): Launched 13:34:20.965836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:21.214622 run patchelf(pid=14109): Launched 13:34:21.378121 run osmo-stp_10.42.42.5(pid=14106): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14106)] 13:34:21.502920 run osmo-stp_10.42.42.5(pid=14106): stdout: | (launched: 2022-12-10_13:34:20.204543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:21.628733 run osmo-stp_10.42.42.5(pid=14106): stderr: | [0;m[38;5;43m20221210133420375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133420375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133420376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133420376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133420377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133420377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133420377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:21.754663 run osmo-stp_10.42.42.5(pid=14106): stdout: | (launched: 2022-12-10_13:34:20.204543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:21.875613 run osmo-stp_10.42.42.5(pid=14106): stderr: | [0;m[38;5;43m20221210133420375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133420375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133420376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133420376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133420377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133420377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133420377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:22.018822 run patchelf(pid=14109): Terminating (SIGINT) 13:34:22.185781 run patchelf(pid=14109): Terminated: ok {rc=0} 13:34:22.305780 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14106): Process ended prematurely: osmo-stp_10.42.42.5(pid=14106) [trial-2375↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14106)] [trial-2375↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:34:22.314447 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 13:34:22.340468 run osmo-hlr_10.42.42.2(pid=14103): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14103)] 13:34:22.387329 run osmo-hlr_10.42.42.2(pid=14103): stdout: | (launched: 2022-12-10_13:34:19.317611) 13:34:22.435736 run osmo-hlr_10.42.42.2(pid=14103): stderr: | [0;m[1;31m20221210133419493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133419493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133419493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133419494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133419494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133419494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133419506 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133419514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133419515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133419515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:22.484456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14102): Terminating (SIGTERM) 13:34:22.523404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14105): Terminating (SIGTERM) 13:34:22.562362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14108): Terminating (SIGTERM) 13:34:22.602089 --- ParallelTerminationStrategy: PID 14102 died... 13:34:22.620815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14102): Terminated: ok {rc=0} 13:34:22.663780 --- ParallelTerminationStrategy: PID 14105 died... 13:34:22.682041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14105): Terminated: ok {rc=0} 13:34:22.725409 --- ParallelTerminationStrategy: PID 14108 died... 13:34:22.743576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14108): Terminated: ok {rc=0} 13:34:22.827925 bus /gobi_0: Setting Powered False 13:34:23.926480 bus /gobi_0: Setting Powered False 13:34:25.041435 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 13:34:26.285472 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:34:26.289137 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:34:26.317344 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 13:34:26.323951 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 13:34:26.375373 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:34:26.404906 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 13:34:26.411959 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 13:34:26.951158 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 13:34:26.956517 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 13:34:26.968829 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:34:27.013212 tst mo_mt_sms.py: using LAC 28747 13:34:27.137093 tst mo_mt_sms.py: using RAC 187 13:34:27.267402 tst mo_mt_sms.py: using CellId 28747 13:34:27.401786 tst mo_mt_sms.py: using BVCI 28748 13:34:27.518400 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:34:27.632423 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:34:27.748298 tst mo_mt_sms.py:9: start nitb and bts... 13:34:27.961311 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:34:28.601497 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14113): Launched 13:34:28.917944 run osmo-nitb_10.42.42.2(pid=14114): Launched 13:34:29.091956 run osmo-nitb_10.42.42.2(pid=14114): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14114)] 13:34:29.233613 run osmo-nitb_10.42.42.2(pid=14114): stdout: | (launched: 2022-12-10_13:34:28.860277) 13:34:29.376041 run osmo-nitb_10.42.42.2(pid=14114): stderr: | (launched: 2022-12-10_13:34:28.907488) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:34:29.518346 run osmo-nitb_10.42.42.2(pid=14114): stdout: | (launched: 2022-12-10_13:34:28.860277) 13:34:29.654966 run osmo-nitb_10.42.42.2(pid=14114): stderr: | (launched: 2022-12-10_13:34:28.907488) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14114): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14114) [trial-2375↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14114)] 13:34:30.036097 tst osmo-nitb_10.42.42.2(pid=14114): stdout: | (launched: 2022-12-10_13:34:28.860277) 13:34:30.162834 tst osmo-nitb_10.42.42.2(pid=14114): stderr: | (launched: 2022-12-10_13:34:28.907488) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:34:30.311945 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14114): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14114) [trial-2375↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14114)] [trial-2375↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 13:34:30.321074 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 13:34:30.328012 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14113): Terminating (SIGTERM) 13:34:30.538966 --- ParallelTerminationStrategy: PID 14113 died... 13:34:30.560564 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14113): Terminated: ok {rc=0} 13:34:30.648542 bus /sierra_3: Setting Powered False 13:34:31.744673 bus /sierra_3: Setting Powered False 13:34:32.857395 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 13:34:34.051155 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:34:34.054978 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:34:34.083526 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:34:34.109568 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 13:34:34.159319 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:34:34.190124 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:34:34.217626 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 13:34:34.766488 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 13:34:34.771901 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:34:34.783370 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:34:34.827399 tst mo_mt_sms.py: using LAC 28748 13:34:34.954554 tst mo_mt_sms.py: using RAC 188 13:34:35.079769 tst mo_mt_sms.py: using CellId 28748 13:34:35.203642 tst mo_mt_sms.py: using BVCI 28749 13:34:35.318649 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:34:35.329689 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:34:35.340575 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:34:35.351913 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:34:35.363304 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:34:35.374717 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:34:35.488351 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:34:35.602735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:36.059861 run create_hlr_db(pid=14119): Launched 13:34:36.180431 bus /sierra_2: Setting Powered False 13:34:37.239825 run create_hlr_db(pid=14119): Terminated: ok {rc=0} 13:34:37.670608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14121): Launched 13:34:37.985160 run osmo-hlr_10.42.42.2(pid=14122): Launched 13:34:38.105497 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:38.653825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14124): Launched 13:34:38.969692 run osmo-stp_10.42.42.5(pid=14125): Launched 13:34:39.091674 run osmo-msc_10.42.42.6: Starting osmo-msc 13:34:39.666869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14127): Launched 13:34:39.983423 run osmo-msc_10.42.42.6(pid=14128): Launched 13:34:40.159741 run osmo-stp_10.42.42.5(pid=14125): ERR: Terminated: ERROR {rc=1} [trial-2375↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14125)] 13:34:40.293780 run osmo-stp_10.42.42.5(pid=14125): stdout: | (launched: 2022-12-10_13:34:38.911313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:40.428019 run osmo-stp_10.42.42.5(pid=14125): stderr: | [0;m[38;5;43m20221210133439102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133439102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133439102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133439103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133439103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133439103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133439103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:40.561339 run osmo-stp_10.42.42.5(pid=14125): stdout: | (launched: 2022-12-10_13:34:38.911313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:40.686806 run osmo-stp_10.42.42.5(pid=14125): stderr: | [0;m[38;5;43m20221210133439102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133439102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133439102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133439103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133439103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133439103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133439103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:40.837630 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14125): Process ended prematurely: osmo-stp_10.42.42.5(pid=14125) [trial-2375↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14125)] [trial-2375↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 13:34:40.846621 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 13:34:40.874408 run osmo-hlr_10.42.42.2(pid=14122): ERR: Terminated: ERROR {rc=237} [trial-2375↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14122)] 13:34:40.924733 run osmo-hlr_10.42.42.2(pid=14122): stdout: | (launched: 2022-12-10_13:34:37.927612) 13:34:40.976511 run osmo-hlr_10.42.42.2(pid=14122): stderr: | [0;m[1;31m20221210133438125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133438126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133438126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133438126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133438126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133438126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133438139 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133438150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133438150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133438150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:41.048861 run osmo-msc_10.42.42.6(pid=14128): ERR: Terminated: ERROR {rc=2} [trial-2375↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14128)] 13:34:41.099234 run osmo-msc_10.42.42.6(pid=14128): stdout: | (launched: 2022-12-10_13:34:39.925707) 13:34:41.151218 run osmo-msc_10.42.42.6(pid=14128): stderr: | [0;m[38;5;43m20221210133440245 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133440245 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc51e81ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133440245 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133440245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133440246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133440246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133440247 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133440248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133440248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133440248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:34:41.203554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14121): Terminating (SIGTERM) 13:34:41.245538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14124): Terminating (SIGTERM) 13:34:41.287444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14127): Terminating (SIGTERM) 13:34:41.330558 --- ParallelTerminationStrategy: PID 14121 died... 13:34:41.350975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14121): Terminated: ok {rc=0} 13:34:41.397847 --- ParallelTerminationStrategy: PID 14124 died... 13:34:41.417498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14124): Terminated: ok {rc=0} 13:34:41.463970 --- ParallelTerminationStrategy: PID 14127 died... 13:34:41.483546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14127): Terminated: ok {rc=0} 13:34:41.570394 bus /sierra_3: Setting Powered False 13:34:42.667490 bus /sierra_3: Setting Powered False 13:34:43.784104 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 13:34:45.008565 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:34:45.012465 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:34:45.041388 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 13:34:45.047942 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 13:34:45.082522 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:34:45.111935 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 13:34:45.118524 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 13:34:45.636924 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2375 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 13:34:45.641790 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 13:34:45.652376 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:34:45.696453 tst assert_extension.py: using LAC 28749 13:34:45.817245 tst assert_extension.py: using RAC 189 13:34:45.940894 tst assert_extension.py: using CellId 28749 13:34:46.083127 tst assert_extension.py: using BVCI 28750 13:34:46.230871 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 13:34:46.374053 tst assert_extension.py:10: start nitb and bts... 13:34:46.631438 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:34:47.334444 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14133): Launched 13:34:47.630526 run osmo-nitb_10.42.42.2(pid=14134): Launched 13:34:47.794262 run osmo-nitb_10.42.42.2(pid=14134): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14134)] 13:34:47.927503 run osmo-nitb_10.42.42.2(pid=14134): stdout: | (launched: 2022-12-10_13:34:47.576077) 13:34:48.061818 run osmo-nitb_10.42.42.2(pid=14134): stderr: | (launched: 2022-12-10_13:34:47.620160) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:34:48.196311 run osmo-nitb_10.42.42.2(pid=14134): stdout: | (launched: 2022-12-10_13:34:47.576077) 13:34:48.325330 run osmo-nitb_10.42.42.2(pid=14134): stderr: | (launched: 2022-12-10_13:34:47.620160) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14134): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14134) [trial-2375↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14134)] 13:34:48.741323 tst osmo-nitb_10.42.42.2(pid=14134): stdout: | (launched: 2022-12-10_13:34:47.576077) 13:34:48.861207 tst osmo-nitb_10.42.42.2(pid=14134): stderr: | (launched: 2022-12-10_13:34:47.620160) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:34:49.001595 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14134): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14134) [trial-2375↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14134)] [trial-2375↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 13:34:49.009827 tst assert_extension.py:12: Test FAILED (3.4 sec) 13:34:49.016333 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14133): Terminating (SIGTERM) 13:34:49.224132 --- ParallelTerminationStrategy: PID 14133 died... 13:34:49.244284 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14133): Terminated: ok {rc=0} 13:34:49.328546 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 13:34:50.502112 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:34:50.506602 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:34:50.535315 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:34:50.561553 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 13:34:50.597182 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:34:50.626440 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:34:50.652438 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 13:34:51.178844 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2375 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 13:34:51.183678 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:34:51.194285 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:34:51.238348 tst assert_extension.py: using LAC 28750 13:34:51.356345 tst assert_extension.py: using RAC 190 13:34:51.477606 tst assert_extension.py: using CellId 28750 13:34:51.594279 tst assert_extension.py: using BVCI 28751 13:34:51.702163 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:34:51.712692 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:34:51.723649 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:34:51.734585 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:34:51.745609 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:34:51.756366 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 13:34:51.870256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:52.327642 run create_hlr_db(pid=14138): Launched 13:34:52.448818 bus /sierra_2: Setting Powered False 13:34:53.508564 run create_hlr_db(pid=14138): Terminated: ok {rc=0} 13:34:53.940441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14140): Launched 13:34:54.240616 run osmo-hlr_10.42.42.2(pid=14141): Launched 13:34:54.354727 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:54.866485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14143): Launched 13:34:55.162387 run osmo-stp_10.42.42.5(pid=14144): Launched 13:34:55.275099 run osmo-msc_10.42.42.6: Starting osmo-msc 13:34:55.808810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14146): Launched 13:34:56.103521 run osmo-msc_10.42.42.6(pid=14147): Launched 13:34:56.268776 run osmo-stp_10.42.42.5(pid=14144): ERR: Terminated: ERROR {rc=1} [trial-2375↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14144)] 13:34:56.393971 run osmo-stp_10.42.42.5(pid=14144): stdout: | (launched: 2022-12-10_13:34:55.107104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:56.518816 run osmo-stp_10.42.42.5(pid=14144): stderr: | [0;m[38;5;43m20221210133455278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133455279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133455279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133455279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133455280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133455280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133455280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:56.641212 run osmo-stp_10.42.42.5(pid=14144): stdout: | (launched: 2022-12-10_13:34:55.107104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:56.757797 run osmo-stp_10.42.42.5(pid=14144): stderr: | [0;m[38;5;43m20221210133455278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133455279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133455279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133455279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133455280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133455280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133455280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:56.898424 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14144): Process ended prematurely: osmo-stp_10.42.42.5(pid=14144) [trial-2375↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14144)] [trial-2375↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 13:34:56.906416 tst assert_extension.py:17: Test FAILED (5.7 sec) 13:34:56.932211 run osmo-hlr_10.42.42.2(pid=14141): ERR: Terminated: ERROR {rc=237} [trial-2375↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14141)] 13:34:56.979219 run osmo-hlr_10.42.42.2(pid=14141): stdout: | (launched: 2022-12-10_13:34:54.185777) 13:34:57.028149 run osmo-hlr_10.42.42.2(pid=14141): stderr: | [0;m[1;31m20221210133454361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133454361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133454361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133454361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133454361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133454361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133454373 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133454382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133454382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133454382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:57.096619 run osmo-msc_10.42.42.6(pid=14147): ERR: Terminated: ERROR {rc=2} [trial-2375↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14147)] 13:34:57.143893 run osmo-msc_10.42.42.6(pid=14147): stdout: | (launched: 2022-12-10_13:34:56.049244) 13:34:57.192883 run osmo-msc_10.42.42.6(pid=14147): stderr: | [0;m[38;5;43m20221210133456320 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133456320 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f93004dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133456320 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133456320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133456321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133456321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133456323 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133456324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133456324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133456324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:34:57.242114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14140): Terminating (SIGTERM) 13:34:57.281440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14143): Terminating (SIGTERM) 13:34:57.320675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14146): Terminating (SIGTERM) 13:34:57.361543 --- ParallelTerminationStrategy: PID 14140 died... 13:34:57.380282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14140): Terminated: ok {rc=0} 13:34:57.424510 --- ParallelTerminationStrategy: PID 14143 died... 13:34:57.442984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14143): Terminated: ok {rc=0} 13:34:57.486349 --- ParallelTerminationStrategy: PID 14146 died... 13:34:57.504478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14146): Terminated: ok {rc=0} 13:34:57.586964 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:34:58.794505 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:34:58.801935 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:34:58.833078 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:34:58.860576 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:34:58.913819 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:34:58.944295 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:34:58.971432 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:34:59.522855 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:34:59.575393 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:34:59.587152 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:34:59.653862 tst mo_mt_call.py: using LAC 28751 13:34:59.774255 tst mo_mt_call.py: using RAC 191 13:34:59.894717 tst mo_mt_call.py: using CellId 28751 13:35:00.017081 tst mo_mt_call.py: using BVCI 28752 13:35:00.127744 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:35:00.138994 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:35:00.150109 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:35:00.161196 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:35:00.172198 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:35:00.183120 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:35:00.301296 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:35:00.421692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:00.946832 run create_hlr_db(pid=14153): Launched 13:35:01.213624 bus /sierra_2: Setting Powered False 13:35:02.280764 run create_hlr_db(pid=14153): Terminated: ok {rc=0} 13:35:02.759719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14161): Launched 13:35:03.081434 run osmo-hlr_10.42.42.2(pid=14162): Launched 13:35:03.204737 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:03.763289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14164): Launched 13:35:04.086302 run osmo-stp_10.42.42.5(pid=14165): Launched 13:35:04.209970 run osmo-msc_10.42.42.6: Starting osmo-msc 13:35:04.791463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14167): Launched 13:35:05.113156 run osmo-msc_10.42.42.6(pid=14168): Launched 13:35:05.292823 run osmo-stp_10.42.42.5(pid=14165): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14165)] 13:35:05.428680 run osmo-stp_10.42.42.5(pid=14165): stdout: | (launched: 2022-12-10_13:35:04.027759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:05.565090 run osmo-stp_10.42.42.5(pid=14165): stderr: | [0;m[38;5;43m20221210133504219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133504219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133504219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133504220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133504220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133504220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133504220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:05.700525 run osmo-stp_10.42.42.5(pid=14165): stdout: | (launched: 2022-12-10_13:35:04.027759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:05.828529 run osmo-stp_10.42.42.5(pid=14165): stderr: | [0;m[38;5;43m20221210133504219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133504219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133504219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133504220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133504220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133504220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133504220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:05.981325 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14165): Process ended prematurely: osmo-stp_10.42.42.5(pid=14165) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14165)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:35:05.990686 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:35:06.018946 run osmo-hlr_10.42.42.2(pid=14162): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14162)] 13:35:06.068608 run osmo-hlr_10.42.42.2(pid=14162): stdout: | (launched: 2022-12-10_13:35:03.023065) 13:35:06.120028 run osmo-hlr_10.42.42.2(pid=14162): stderr: | [0;m[1;31m20221210133503222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133503222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133503222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133503222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133503222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133503222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133503234 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133503242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133503242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133503242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:06.191553 run osmo-msc_10.42.42.6(pid=14168): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14168)] 13:35:06.241043 run osmo-msc_10.42.42.6(pid=14168): stdout: | (launched: 2022-12-10_13:35:05.054686) 13:35:06.292275 run osmo-msc_10.42.42.6(pid=14168): stderr: | [0;m[38;5;43m20221210133505374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133505374 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5362565c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133505374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133505374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133505374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133505375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133505376 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133505377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133505377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133505377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:35:06.344055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14161): Terminating (SIGTERM) 13:35:06.385316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14164): Terminating (SIGTERM) 13:35:06.427106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14167): Terminating (SIGTERM) 13:35:06.468773 --- ParallelTerminationStrategy: PID 14161 died... 13:35:06.488488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14161): Terminated: ok {rc=0} 13:35:06.534404 --- ParallelTerminationStrategy: PID 14164 died... 13:35:06.553623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14164): Terminated: ok {rc=0} 13:35:06.599382 --- ParallelTerminationStrategy: PID 14167 died... 13:35:06.618611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14167): Terminated: ok {rc=0} 13:35:06.705118 bus /sierra_3: Setting Powered False 13:35:07.803251 bus /sierra_3: Setting Powered False 13:35:08.920010 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:35:10.063897 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:35:10.076169 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:35:10.140931 tst mo_mt_call_osmux.py: using LAC 28752 13:35:10.259407 tst mo_mt_call_osmux.py: using RAC 192 13:35:10.380089 tst mo_mt_call_osmux.py: using CellId 28752 13:35:10.500304 tst mo_mt_call_osmux.py: using BVCI 28753 13:35:10.610256 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:35:10.621518 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:35:10.632466 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:35:10.643445 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:35:10.654866 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:35:10.665891 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:35:10.784313 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:35:10.903616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:11.405264 run create_hlr_db(pid=14170): Launched 13:35:11.527733 bus /sierra_2: Setting Powered False 13:35:12.591476 run create_hlr_db(pid=14170): Terminated: ok {rc=0} 13:35:13.021707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14172): Launched 13:35:13.323065 run osmo-hlr_10.42.42.2(pid=14173): Launched 13:35:13.438425 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:13.959023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14175): Launched 13:35:14.258397 run osmo-stp_10.42.42.5(pid=14176): Launched 13:35:14.372621 run osmo-msc_10.42.42.6: Starting osmo-msc 13:35:14.919449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14178): Launched 13:35:15.220329 run osmo-msc_10.42.42.6(pid=14179): Launched 13:35:15.389958 run osmo-stp_10.42.42.5(pid=14176): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14176)] 13:35:15.518582 run osmo-stp_10.42.42.5(pid=14176): stdout: | (launched: 2022-12-10_13:35:14.203302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:15.645867 run osmo-stp_10.42.42.5(pid=14176): stderr: | [0;m[38;5;43m20221210133514373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133514373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133514373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133514374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133514376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133514376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133514376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:15.771562 run osmo-stp_10.42.42.5(pid=14176): stdout: | (launched: 2022-12-10_13:35:14.203302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:15.897833 run osmo-stp_10.42.42.5(pid=14176): stderr: | [0;m[38;5;43m20221210133514373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133514373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133514373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133514374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133514376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133514376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133514376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:16.043443 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14176): Process ended prematurely: osmo-stp_10.42.42.5(pid=14176) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14176)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:35:16.052614 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:35:16.079601 run osmo-hlr_10.42.42.2(pid=14173): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14173)] 13:35:16.127725 run osmo-hlr_10.42.42.2(pid=14173): stdout: | (launched: 2022-12-10_13:35:13.267834) 13:35:16.177471 run osmo-hlr_10.42.42.2(pid=14173): stderr: | [0;m[1;31m20221210133513444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133513444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133513444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133513445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133513445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133513445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133513458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133513470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133513470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133513470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:16.246993 run osmo-msc_10.42.42.6(pid=14179): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14179)] 13:35:16.295052 run osmo-msc_10.42.42.6(pid=14179): stdout: | (launched: 2022-12-10_13:35:15.165254) 13:35:16.344711 run osmo-msc_10.42.42.6(pid=14179): stderr: | [0;m[38;5;43m20221210133515436 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133515436 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f05910f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133515436 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133515436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133515437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133515437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133515439 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133515439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133515439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133515439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:35:16.394971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14172): Terminating (SIGTERM) 13:35:16.435269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14175): Terminating (SIGTERM) 13:35:16.476622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14178): Terminating (SIGTERM) 13:35:16.517250 --- ParallelTerminationStrategy: PID 14172 died... 13:35:16.536349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14172): Terminated: ok {rc=0} 13:35:16.580821 --- ParallelTerminationStrategy: PID 14175 died... 13:35:16.599757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14175): Terminated: ok {rc=0} 13:35:16.643791 --- ParallelTerminationStrategy: PID 14178 died... 13:35:16.662737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14178): Terminated: ok {rc=0} 13:35:16.746115 bus /sierra_3: Setting Powered False 13:35:17.841092 bus /sierra_3: Setting Powered False 13:35:18.955056 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:35:20.199111 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:35:20.205695 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:35:20.234079 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:35:20.260439 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:35:20.310425 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:35:20.338598 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:35:20.364587 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:35:20.917589 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:35:20.971030 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:35:20.983050 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:35:21.049579 tst mo_mt_call.py: using LAC 28753 13:35:21.170879 tst mo_mt_call.py: using RAC 193 13:35:21.292099 tst mo_mt_call.py: using CellId 28753 13:35:21.415326 tst mo_mt_call.py: using BVCI 28754 13:35:21.525505 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:35:21.536696 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:35:21.547930 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:35:21.558819 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:35:21.569750 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:35:21.580613 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:35:21.698616 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:35:21.815028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:22.282688 run create_hlr_db(pid=14184): Launched 13:35:22.405247 bus /sierra_2: Setting Powered False 13:35:23.465683 run create_hlr_db(pid=14184): Terminated: ok {rc=0} 13:35:23.904090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14186): Launched 13:35:24.224851 run osmo-hlr_10.42.42.2(pid=14187): Launched 13:35:24.348429 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:24.905697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14189): Launched 13:35:25.226710 run osmo-stp_10.42.42.5(pid=14190): Launched 13:35:25.350425 run osmo-msc_10.42.42.6: Starting osmo-msc 13:35:25.931911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14192): Launched 13:35:26.253344 run osmo-msc_10.42.42.6(pid=14193): Launched 13:35:26.433532 run osmo-stp_10.42.42.5(pid=14190): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14190)] 13:35:26.569670 run osmo-stp_10.42.42.5(pid=14190): stdout: | (launched: 2022-12-10_13:35:25.167908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:26.706453 run osmo-stp_10.42.42.5(pid=14190): stderr: | [0;m[38;5;43m20221210133525360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133525360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133525360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133525361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133525361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133525361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133525361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:26.842301 run osmo-stp_10.42.42.5(pid=14190): stdout: | (launched: 2022-12-10_13:35:25.167908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:26.969879 run osmo-stp_10.42.42.5(pid=14190): stderr: | [0;m[38;5;43m20221210133525360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133525360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133525360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133525361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133525361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133525361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133525361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:27.123178 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14190): Process ended prematurely: osmo-stp_10.42.42.5(pid=14190) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14190)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:35:27.132535 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:35:27.160599 run osmo-hlr_10.42.42.2(pid=14187): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14187)] 13:35:27.210274 run osmo-hlr_10.42.42.2(pid=14187): stdout: | (launched: 2022-12-10_13:35:24.166545) 13:35:27.261542 run osmo-hlr_10.42.42.2(pid=14187): stderr: | [0;m[1;31m20221210133524366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133524366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133524366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133524366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133524366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133524366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133524378 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133524386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133524387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133524387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:27.333412 run osmo-msc_10.42.42.6(pid=14193): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14193)] 13:35:27.383213 run osmo-msc_10.42.42.6(pid=14193): stdout: | (launched: 2022-12-10_13:35:26.194561) 13:35:27.434448 run osmo-msc_10.42.42.6(pid=14193): stderr: | [0;m[38;5;43m20221210133526515 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133526515 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7f00948c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133526515 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133526515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133526516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133526516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133526517 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133526518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133526518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133526518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:35:27.486027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14186): Terminating (SIGTERM) 13:35:27.527298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14189): Terminating (SIGTERM) 13:35:27.568608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14192): Terminating (SIGTERM) 13:35:27.610389 --- ParallelTerminationStrategy: PID 14186 died... 13:35:27.630229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14186): Terminated: ok {rc=0} 13:35:27.676611 --- ParallelTerminationStrategy: PID 14189 died... 13:35:27.695961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14189): Terminated: ok {rc=0} 13:35:27.742025 --- ParallelTerminationStrategy: PID 14192 died... 13:35:27.761386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14192): Terminated: ok {rc=0} 13:35:27.849153 bus /sierra_3: Setting Powered False 13:35:28.946126 bus /sierra_3: Setting Powered False 13:35:30.061039 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:35:31.208409 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:35:31.221762 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:35:31.291882 tst mo_mt_call_osmux.py: using LAC 28754 13:35:31.417788 tst mo_mt_call_osmux.py: using RAC 194 13:35:31.539633 tst mo_mt_call_osmux.py: using CellId 28754 13:35:31.661246 tst mo_mt_call_osmux.py: using BVCI 28755 13:35:31.777611 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:35:31.789442 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:35:31.801284 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:35:31.813123 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:35:31.825037 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:35:31.836680 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:35:31.955465 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:35:32.084100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:32.590257 run create_hlr_db(pid=14195): Launched 13:35:32.714526 bus /sierra_2: Setting Powered False 13:35:33.778194 run create_hlr_db(pid=14195): Terminated: ok {rc=0} 13:35:34.208771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14197): Launched 13:35:34.510066 run osmo-hlr_10.42.42.2(pid=14198): Launched 13:35:34.625506 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:35.162161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14200): Launched 13:35:35.463199 run osmo-stp_10.42.42.5(pid=14201): Launched 13:35:35.578303 run osmo-msc_10.42.42.6: Starting osmo-msc 13:35:36.123910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14203): Launched 13:35:36.425583 run osmo-msc_10.42.42.6(pid=14204): Launched 13:35:36.595608 run osmo-stp_10.42.42.5(pid=14201): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14201)] 13:35:36.723706 run osmo-stp_10.42.42.5(pid=14201): stdout: | (launched: 2022-12-10_13:35:35.407890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:36.851704 run osmo-stp_10.42.42.5(pid=14201): stderr: | [0;m[38;5;43m20221210133535579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133535579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133535579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133535580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133535580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133535580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133535580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:36.977931 run osmo-stp_10.42.42.5(pid=14201): stdout: | (launched: 2022-12-10_13:35:35.407890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:37.098166 run osmo-stp_10.42.42.5(pid=14201): stderr: | [0;m[38;5;43m20221210133535579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133535579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133535579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133535580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133535580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133535580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133535580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:37.242910 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14201): Process ended prematurely: osmo-stp_10.42.42.5(pid=14201) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14201)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:35:37.251887 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:35:37.278773 run osmo-hlr_10.42.42.2(pid=14198): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14198)] 13:35:37.326208 run osmo-hlr_10.42.42.2(pid=14198): stdout: | (launched: 2022-12-10_13:35:34.454944) 13:35:37.375242 run osmo-hlr_10.42.42.2(pid=14198): stderr: | [0;m[1;31m20221210133534629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133534629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133534629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133534629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133534629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133534629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133534642 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133534651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133534651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133534651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:37.443700 run osmo-msc_10.42.42.6(pid=14204): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14204)] 13:35:37.491033 run osmo-msc_10.42.42.6(pid=14204): stdout: | (launched: 2022-12-10_13:35:36.369991) 13:35:37.539898 run osmo-msc_10.42.42.6(pid=14204): stderr: | [0;m[38;5;43m20221210133536641 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133536641 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6cc80f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133536641 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133536641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133536642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133536642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133536643 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133536645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133536645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133536645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:35:37.589207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14197): Terminating (SIGTERM) 13:35:37.628113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14200): Terminating (SIGTERM) 13:35:37.667355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14203): Terminating (SIGTERM) 13:35:37.706860 --- ParallelTerminationStrategy: PID 14197 died... 13:35:37.725578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14197): Terminated: ok {rc=0} 13:35:37.769321 --- ParallelTerminationStrategy: PID 14200 died... 13:35:37.788021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14200): Terminated: ok {rc=0} 13:35:37.831846 --- ParallelTerminationStrategy: PID 14203 died... 13:35:37.850462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14203): Terminated: ok {rc=0} 13:35:37.934343 bus /sierra_3: Setting Powered False 13:35:39.032410 bus /sierra_3: Setting Powered False 13:35:40.146278 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:35:41.387318 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:35:41.393575 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:35:41.422359 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:35:41.448885 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:35:41.500097 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:35:41.529078 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:35:41.555243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:35:42.106886 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:35:42.155472 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:35:42.166776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:35:42.230315 tst mo_mt_call.py: using LAC 28755 13:35:42.348185 tst mo_mt_call.py: using RAC 195 13:35:42.477188 tst mo_mt_call.py: using CellId 28755 13:35:42.603231 tst mo_mt_call.py: using BVCI 28756 13:35:42.721413 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:35:42.732795 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:35:42.744227 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:35:42.756359 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:35:42.768493 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:35:42.780501 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:35:42.897192 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:35:43.017474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:43.518363 run create_hlr_db(pid=14209): Launched 13:35:43.640606 bus /sierra_2: Setting Powered False 13:35:44.704801 run create_hlr_db(pid=14209): Terminated: ok {rc=0} 13:35:45.135334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14211): Launched 13:35:45.437999 run osmo-hlr_10.42.42.2(pid=14212): Launched 13:35:45.553371 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:46.119462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14214): Launched 13:35:46.441755 run osmo-stp_10.42.42.5(pid=14215): Launched 13:35:46.676720 run osmo-msc_10.42.42.6: Starting osmo-msc 13:35:47.367419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14217): Launched 13:35:47.670775 run osmo-msc_10.42.42.6(pid=14218): Launched 13:35:47.839408 run osmo-stp_10.42.42.5(pid=14215): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14215)] 13:35:47.967494 run osmo-stp_10.42.42.5(pid=14215): stdout: | (launched: 2022-12-10_13:35:46.371692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:48.094661 run osmo-stp_10.42.42.5(pid=14215): stderr: | [0;m[38;5;43m20221210133546696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133546696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133546696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133546705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133546706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133546706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133546706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:48.219974 run osmo-stp_10.42.42.5(pid=14215): stdout: | (launched: 2022-12-10_13:35:46.371692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:48.339636 run osmo-stp_10.42.42.5(pid=14215): stderr: | [0;m[38;5;43m20221210133546696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133546696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133546696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133546705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133546706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133546706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133546706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:48.482787 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14215): Process ended prematurely: osmo-stp_10.42.42.5(pid=14215) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14215)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:35:48.491780 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:35:48.518045 run osmo-hlr_10.42.42.2(pid=14212): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14212)] 13:35:48.566366 run osmo-hlr_10.42.42.2(pid=14212): stdout: | (launched: 2022-12-10_13:35:45.382577) 13:35:48.614744 run osmo-hlr_10.42.42.2(pid=14212): stderr: | [0;m[1;31m20221210133545558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133545558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133545558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133545558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133545558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133545558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133545570 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133545579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133545579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133545579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:48.682515 run osmo-msc_10.42.42.6(pid=14218): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14218)] 13:35:48.729448 run osmo-msc_10.42.42.6(pid=14218): stdout: | (launched: 2022-12-10_13:35:47.614188) 13:35:48.777632 run osmo-msc_10.42.42.6(pid=14218): stderr: | [0;m[38;5;43m20221210133547888 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133547888 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f26f1cd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133547889 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133547889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133547889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133547889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133547892 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133547892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133547893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133547893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:35:48.826517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14211): Terminating (SIGTERM) 13:35:48.865299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14214): Terminating (SIGTERM) 13:35:48.903924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14217): Terminating (SIGTERM) 13:35:48.942874 --- ParallelTerminationStrategy: PID 14211 died... 13:35:48.961505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14211): Terminated: ok {rc=0} 13:35:49.004878 --- ParallelTerminationStrategy: PID 14214 died... 13:35:49.023700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14214): Terminated: ok {rc=0} 13:35:49.067125 --- ParallelTerminationStrategy: PID 14217 died... 13:35:49.085628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14217): Terminated: ok {rc=0} 13:35:49.167974 bus /sierra_3: Setting Powered False 13:35:50.265105 bus /sierra_3: Setting Powered False 13:35:51.381221 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:35:52.528260 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:35:52.540143 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:35:52.604818 tst mo_mt_call_osmux.py: using LAC 28756 13:35:52.723343 tst mo_mt_call_osmux.py: using RAC 196 13:35:52.842069 tst mo_mt_call_osmux.py: using CellId 28756 13:35:52.965411 tst mo_mt_call_osmux.py: using BVCI 28757 13:35:53.076801 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:35:53.088167 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:35:53.099312 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:35:53.110439 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:35:53.121676 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:35:53.132709 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:35:53.246884 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:35:53.366595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:53.866655 run create_hlr_db(pid=14220): Launched 13:35:53.989607 bus /sierra_2: Setting Powered False 13:35:55.053447 run create_hlr_db(pid=14220): Terminated: ok {rc=0} 13:35:55.482907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14222): Launched 13:35:55.785765 run osmo-hlr_10.42.42.2(pid=14223): Launched 13:35:55.898265 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:56.409016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14225): Launched 13:35:56.706214 run osmo-stp_10.42.42.5(pid=14226): Launched 13:35:56.819077 run osmo-msc_10.42.42.6: Starting osmo-msc 13:35:57.355689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14228): Launched 13:35:57.651394 run osmo-msc_10.42.42.6(pid=14229): Launched 13:35:57.816881 run osmo-stp_10.42.42.5(pid=14226): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14226)] 13:35:57.942509 run osmo-stp_10.42.42.5(pid=14226): stdout: | (launched: 2022-12-10_13:35:56.651738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:58.068228 run osmo-stp_10.42.42.5(pid=14226): stderr: | [0;m[38;5;43m20221210133556820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133556820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133556820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133556821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133556823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133556823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133556823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:58.191966 run osmo-stp_10.42.42.5(pid=14226): stdout: | (launched: 2022-12-10_13:35:56.651738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:58.310191 run osmo-stp_10.42.42.5(pid=14226): stderr: | [0;m[38;5;43m20221210133556820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133556820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133556820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133556821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133556823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133556823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133556823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:58.451504 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14226): Process ended prematurely: osmo-stp_10.42.42.5(pid=14226) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14226)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:35:58.460275 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:35:58.486701 run osmo-hlr_10.42.42.2(pid=14223): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14223)] 13:35:58.534267 run osmo-hlr_10.42.42.2(pid=14223): stdout: | (launched: 2022-12-10_13:35:55.731803) 13:35:58.583453 run osmo-hlr_10.42.42.2(pid=14223): stderr: | [0;m[1;31m20221210133555909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133555909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133555909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133555909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133555909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133555909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133555922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133555930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133555930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133555930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:58.651951 run osmo-msc_10.42.42.6(pid=14229): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14229)] 13:35:58.699267 run osmo-msc_10.42.42.6(pid=14229): stdout: | (launched: 2022-12-10_13:35:57.597321) 13:35:58.747855 run osmo-msc_10.42.42.6(pid=14229): stderr: | [0;m[38;5;43m20221210133557874 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133557874 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7531699c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133557874 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133557874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133557874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133557874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133557876 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133557877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133557877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133557877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:35:58.797659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14222): Terminating (SIGTERM) 13:35:58.836647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14225): Terminating (SIGTERM) 13:35:58.875608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14228): Terminating (SIGTERM) 13:35:58.915158 --- ParallelTerminationStrategy: PID 14222 died... 13:35:58.934055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14222): Terminated: ok {rc=0} 13:35:58.977798 --- ParallelTerminationStrategy: PID 14225 died... 13:35:58.996372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14225): Terminated: ok {rc=0} 13:35:59.039721 --- ParallelTerminationStrategy: PID 14228 died... 13:35:59.058281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14228): Terminated: ok {rc=0} 13:35:59.143156 bus /sierra_3: Setting Powered False 13:36:00.239521 bus /sierra_3: Setting Powered False 13:36:01.358015 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:36:02.603708 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:36:02.610118 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:36:02.638878 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:36:02.664802 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:36:02.715364 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:36:02.743912 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:36:02.769966 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:36:03.326235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:36:03.376542 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:36:03.387762 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:36:03.450120 tst mo_mt_call.py: using LAC 28757 13:36:03.568830 tst mo_mt_call.py: using RAC 197 13:36:03.686122 tst mo_mt_call.py: using CellId 28757 13:36:03.801945 tst mo_mt_call.py: using BVCI 28758 13:36:03.910412 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:36:03.921494 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:36:03.932301 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:36:03.943468 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:36:03.954653 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:36:03.965708 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:36:04.084603 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:36:04.204660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:04.700759 run create_hlr_db(pid=14234): Launched 13:36:04.823285 bus /sierra_2: Setting Powered False 13:36:05.887039 run create_hlr_db(pid=14234): Terminated: ok {rc=0} 13:36:06.312737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14236): Launched 13:36:06.610615 run osmo-hlr_10.42.42.2(pid=14237): Launched 13:36:06.724160 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:07.254548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14239): Launched 13:36:07.551870 run osmo-stp_10.42.42.5(pid=14240): Launched 13:36:07.665585 run osmo-msc_10.42.42.6: Starting osmo-msc 13:36:08.204931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14242): Launched 13:36:08.503393 run osmo-msc_10.42.42.6(pid=14243): Launched 13:36:08.670991 run osmo-stp_10.42.42.5(pid=14240): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14240)] 13:36:08.797844 run osmo-stp_10.42.42.5(pid=14240): stdout: | (launched: 2022-12-10_13:36:07.497720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:08.925148 run osmo-stp_10.42.42.5(pid=14240): stderr: | [0;m[38;5;43m20221210133607670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133607670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133607670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133607670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133607671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133607671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133607671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:09.049999 run osmo-stp_10.42.42.5(pid=14240): stdout: | (launched: 2022-12-10_13:36:07.497720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:09.168619 run osmo-stp_10.42.42.5(pid=14240): stderr: | [0;m[38;5;43m20221210133607670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133607670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133607670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133607670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133607671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133607671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133607671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:09.310557 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14240): Process ended prematurely: osmo-stp_10.42.42.5(pid=14240) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14240)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:36:09.319337 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:36:09.345419 run osmo-hlr_10.42.42.2(pid=14237): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14237)] 13:36:09.392372 run osmo-hlr_10.42.42.2(pid=14237): stdout: | (launched: 2022-12-10_13:36:06.555985) 13:36:09.441381 run osmo-hlr_10.42.42.2(pid=14237): stderr: | [0;m[1;31m20221210133606733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133606733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133606733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133606733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133606733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133606733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133606745 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133606754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133606754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133606754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:09.509190 run osmo-msc_10.42.42.6(pid=14243): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14243)] 13:36:09.555916 run osmo-msc_10.42.42.6(pid=14243): stdout: | (launched: 2022-12-10_13:36:08.448576) 13:36:09.604016 run osmo-msc_10.42.42.6(pid=14243): stderr: | [0;m[38;5;43m20221210133608721 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133608721 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fea89997c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133608721 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133608721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133608721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133608722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133608724 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133608725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133608725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133608725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:36:09.652522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14236): Terminating (SIGTERM) 13:36:09.691382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14239): Terminating (SIGTERM) 13:36:09.730296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14242): Terminating (SIGTERM) 13:36:09.769753 --- ParallelTerminationStrategy: PID 14236 died... 13:36:09.788613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14236): Terminated: ok {rc=0} 13:36:09.832528 --- ParallelTerminationStrategy: PID 14239 died... 13:36:09.851099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14239): Terminated: ok {rc=0} 13:36:09.894191 --- ParallelTerminationStrategy: PID 14242 died... 13:36:09.912686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14242): Terminated: ok {rc=0} 13:36:09.997299 bus /sierra_3: Setting Powered False 13:36:11.095530 bus /sierra_3: Setting Powered False 13:36:12.210070 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:36:13.357834 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:36:13.369911 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:36:13.436033 tst mo_mt_call_osmux.py: using LAC 28758 13:36:13.562503 tst mo_mt_call_osmux.py: using RAC 198 13:36:13.681025 tst mo_mt_call_osmux.py: using CellId 28758 13:36:13.799773 tst mo_mt_call_osmux.py: using BVCI 28759 13:36:13.907706 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:36:13.918987 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:36:13.930178 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:36:13.941307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:36:13.952322 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:36:13.963132 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:36:14.079234 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:36:14.198327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:14.693151 run create_hlr_db(pid=14245): Launched 13:36:14.814625 bus /sierra_2: Setting Powered False 13:36:15.888640 run create_hlr_db(pid=14245): Terminated: ok {rc=0} 13:36:16.339661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14247): Launched 13:36:16.668005 run osmo-hlr_10.42.42.2(pid=14248): Launched 13:36:16.979647 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:17.524309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14250): Launched 13:36:17.822878 run osmo-stp_10.42.42.5(pid=14251): Launched 13:36:17.936541 run osmo-msc_10.42.42.6: Starting osmo-msc 13:36:18.476014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14253): Launched 13:36:18.772867 run osmo-msc_10.42.42.6(pid=14254): Launched 13:36:18.939606 run osmo-stp_10.42.42.5(pid=14251): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14251)] 13:36:19.065535 run osmo-stp_10.42.42.5(pid=14251): stdout: | (launched: 2022-12-10_13:36:17.768185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:19.191930 run osmo-stp_10.42.42.5(pid=14251): stderr: | [0;m[38;5;43m20221210133617937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133617937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133617938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133617938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133617940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133617940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133617941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:19.317296 run osmo-stp_10.42.42.5(pid=14251): stdout: | (launched: 2022-12-10_13:36:17.768185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:19.435987 run osmo-stp_10.42.42.5(pid=14251): stderr: | [0;m[38;5;43m20221210133617937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133617937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133617938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133617938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133617940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133617940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133617941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:19.578475 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14251): Process ended prematurely: osmo-stp_10.42.42.5(pid=14251) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14251)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:36:19.587338 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:36:19.614085 run osmo-hlr_10.42.42.2(pid=14248): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14248)] 13:36:19.661742 run osmo-hlr_10.42.42.2(pid=14248): stdout: | (launched: 2022-12-10_13:36:16.600791) 13:36:19.710906 run osmo-hlr_10.42.42.2(pid=14248): stderr: | [0;m[1;31m20221210133616819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133616819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133616819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133616819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133616819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133616819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133616834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133616852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133616852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133616852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:19.779339 run osmo-msc_10.42.42.6(pid=14254): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14254)] 13:36:19.826799 run osmo-msc_10.42.42.6(pid=14254): stdout: | (launched: 2022-12-10_13:36:18.718478) 13:36:19.875567 run osmo-msc_10.42.42.6(pid=14254): stderr: | [0;m[38;5;43m20221210133618994 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133618994 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbd03830c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133618994 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133618994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133618994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133618994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133618996 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133618997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133618997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133618997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:36:19.924794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14247): Terminating (SIGTERM) 13:36:19.964076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14250): Terminating (SIGTERM) 13:36:20.003215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14253): Terminating (SIGTERM) 13:36:20.042950 --- ParallelTerminationStrategy: PID 14247 died... 13:36:20.061946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14247): Terminated: ok {rc=0} 13:36:20.106126 --- ParallelTerminationStrategy: PID 14250 died... 13:36:20.124859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14250): Terminated: ok {rc=0} 13:36:20.168877 --- ParallelTerminationStrategy: PID 14253 died... 13:36:20.187978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14253): Terminated: ok {rc=0} 13:36:20.273968 bus /sierra_3: Setting Powered False 13:36:21.371891 bus /sierra_3: Setting Powered False 13:36:22.483710 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:36:23.731164 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:36:23.738087 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:36:23.767832 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:36:23.794405 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:36:23.847725 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:36:23.877802 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:36:23.905183 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:36:24.460574 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:36:24.511700 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:36:24.523240 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:36:24.587281 tst mo_mt_call.py: using LAC 28759 13:36:24.711398 tst mo_mt_call.py: using RAC 199 13:36:24.835564 tst mo_mt_call.py: using CellId 28759 13:36:24.954950 tst mo_mt_call.py: using BVCI 28760 13:36:25.065810 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:36:25.077112 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:36:25.088089 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:36:25.099729 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:36:25.111347 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:36:25.122964 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:36:25.243356 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:36:25.360521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:25.856131 run create_hlr_db(pid=14262): Launched 13:36:25.978925 bus /sierra_2: Setting Powered False 13:36:27.042055 run create_hlr_db(pid=14262): Terminated: ok {rc=0} 13:36:27.467734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14264): Launched 13:36:27.766431 run osmo-hlr_10.42.42.2(pid=14265): Launched 13:36:27.880483 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:28.397547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14267): Launched 13:36:28.695520 run osmo-stp_10.42.42.5(pid=14268): Launched 13:36:28.808714 run osmo-msc_10.42.42.6: Starting osmo-msc 13:36:29.347880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14270): Launched 13:36:29.647730 run osmo-msc_10.42.42.6(pid=14271): Launched 13:36:29.814998 run osmo-stp_10.42.42.5(pid=14268): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14268)] 13:36:29.941586 run osmo-stp_10.42.42.5(pid=14268): stdout: | (launched: 2022-12-10_13:36:28.640921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:30.067712 run osmo-stp_10.42.42.5(pid=14268): stderr: | [0;m[38;5;43m20221210133628812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133628812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133628812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133628813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133628813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133628813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133628813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:30.192048 run osmo-stp_10.42.42.5(pid=14268): stdout: | (launched: 2022-12-10_13:36:28.640921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:30.310051 run osmo-stp_10.42.42.5(pid=14268): stderr: | [0;m[38;5;43m20221210133628812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133628812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133628812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133628813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133628813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133628813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133628813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:30.451346 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14268): Process ended prematurely: osmo-stp_10.42.42.5(pid=14268) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14268)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:36:30.460002 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:36:30.485856 run osmo-hlr_10.42.42.2(pid=14265): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14265)] 13:36:30.532396 run osmo-hlr_10.42.42.2(pid=14265): stdout: | (launched: 2022-12-10_13:36:27.711949) 13:36:30.580533 run osmo-hlr_10.42.42.2(pid=14265): stderr: | [0;m[1;31m20221210133627886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133627886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133627886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133627886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133627886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133627886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133627898 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133627907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133627908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133627908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:30.648087 run osmo-msc_10.42.42.6(pid=14271): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14271)] 13:36:30.694598 run osmo-msc_10.42.42.6(pid=14271): stdout: | (launched: 2022-12-10_13:36:29.592639) 13:36:30.742570 run osmo-msc_10.42.42.6(pid=14271): stderr: | [0;m[38;5;43m20221210133629870 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133629870 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe33b08cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133629870 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133629870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133629870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133629870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133629873 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133629873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133629874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133629874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:36:30.791035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14264): Terminating (SIGTERM) 13:36:30.829774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14267): Terminating (SIGTERM) 13:36:30.869892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14270): Terminating (SIGTERM) 13:36:30.922107 --- ParallelTerminationStrategy: PID 14264 died... 13:36:30.942903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14264): Terminated: ok {rc=0} 13:36:30.994088 --- ParallelTerminationStrategy: PID 14267 died... 13:36:31.014574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14267): Terminated: ok {rc=0} 13:36:31.063982 --- ParallelTerminationStrategy: PID 14270 died... 13:36:31.085554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14270): Terminated: ok {rc=0} 13:36:31.176106 bus /sierra_3: Setting Powered False 13:36:32.274018 bus /sierra_3: Setting Powered False 13:36:33.388523 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:36:34.534615 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:36:34.546747 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:36:34.612900 tst mo_mt_call_osmux.py: using LAC 28760 13:36:34.738527 tst mo_mt_call_osmux.py: using RAC 200 13:36:34.863896 tst mo_mt_call_osmux.py: using CellId 28760 13:36:34.990481 tst mo_mt_call_osmux.py: using BVCI 28761 13:36:35.099799 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:36:35.111018 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:36:35.121965 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:36:35.133066 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:36:35.144107 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:36:35.155068 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:36:35.273878 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:36:35.392139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:35.857527 run create_hlr_db(pid=14273): Launched 13:36:35.978860 bus /sierra_2: Setting Powered False 13:36:37.038457 run create_hlr_db(pid=14273): Terminated: ok {rc=0} 13:36:37.474021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14275): Launched 13:36:37.793263 run osmo-hlr_10.42.42.2(pid=14276): Launched 13:36:37.915388 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:38.467725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14278): Launched 13:36:38.785466 run osmo-stp_10.42.42.5(pid=14279): Launched 13:36:38.907732 run osmo-msc_10.42.42.6: Starting osmo-msc 13:36:39.486574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14281): Launched 13:36:39.806003 run osmo-msc_10.42.42.6(pid=14282): Launched 13:36:39.984264 run osmo-stp_10.42.42.5(pid=14279): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14279)] 13:36:40.118614 run osmo-stp_10.42.42.5(pid=14279): stdout: | (launched: 2022-12-10_13:36:38.727730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:40.253204 run osmo-stp_10.42.42.5(pid=14279): stderr: | [0;m[38;5;43m20221210133638922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133638922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133638922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133638923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133638923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133638923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133638923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:40.387086 run osmo-stp_10.42.42.5(pid=14279): stdout: | (launched: 2022-12-10_13:36:38.727730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:40.513997 run osmo-stp_10.42.42.5(pid=14279): stderr: | [0;m[38;5;43m20221210133638922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133638922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133638922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133638923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133638923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133638923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133638923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:40.666122 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14279): Process ended prematurely: osmo-stp_10.42.42.5(pid=14279) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14279)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:36:40.675435 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:36:40.703410 run osmo-hlr_10.42.42.2(pid=14276): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14276)] 13:36:40.753990 run osmo-hlr_10.42.42.2(pid=14276): stdout: | (launched: 2022-12-10_13:36:37.735554) 13:36:40.805788 run osmo-hlr_10.42.42.2(pid=14276): stderr: | [0;m[1;31m20221210133637932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133637932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133637932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133637932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133637932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133637932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133637944 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133637952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133637952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133637952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:40.878753 run osmo-msc_10.42.42.6(pid=14282): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14282)] 13:36:40.928778 run osmo-msc_10.42.42.6(pid=14282): stdout: | (launched: 2022-12-10_13:36:39.747872) 13:36:40.980286 run osmo-msc_10.42.42.6(pid=14282): stderr: | [0;m[38;5;43m20221210133640069 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133640069 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2bde764c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133640070 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133640070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133640070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133640070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133640072 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133640072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133640072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133640072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:36:41.032316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14275): Terminating (SIGTERM) 13:36:41.073931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14278): Terminating (SIGTERM) 13:36:41.115647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14281): Terminating (SIGTERM) 13:36:41.157767 --- ParallelTerminationStrategy: PID 14275 died... 13:36:41.177517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14275): Terminated: ok {rc=0} 13:36:41.223741 --- ParallelTerminationStrategy: PID 14278 died... 13:36:41.243287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14278): Terminated: ok {rc=0} 13:36:41.289816 --- ParallelTerminationStrategy: PID 14281 died... 13:36:41.309284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14281): Terminated: ok {rc=0} 13:36:41.396493 bus /sierra_3: Setting Powered False 13:36:42.494338 bus /sierra_3: Setting Powered False 13:36:43.608721 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:36:44.850593 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:36:44.857056 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:36:44.885604 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:36:44.912040 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:36:44.963240 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:36:44.992063 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:36:45.018173 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:36:45.569879 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:36:45.617267 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:36:45.628371 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:36:45.693001 tst mo_mt_call.py: using LAC 28761 13:36:45.810902 tst mo_mt_call.py: using RAC 201 13:36:45.962402 tst mo_mt_call.py: using CellId 28761 13:36:46.082630 tst mo_mt_call.py: using BVCI 28762 13:36:46.203050 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:36:46.215674 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:36:46.229388 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:36:46.242893 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:36:46.255413 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:36:46.272134 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:36:46.398982 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:36:46.536341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:47.024346 run create_hlr_db(pid=14287): Launched 13:36:47.180371 bus /sierra_2: Setting Powered False 13:36:48.240619 run create_hlr_db(pid=14287): Terminated: ok {rc=0} 13:36:48.677298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14289): Launched 13:36:48.997223 run osmo-hlr_10.42.42.2(pid=14290): Launched 13:36:49.119416 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:49.672449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14292): Launched 13:36:49.992527 run osmo-stp_10.42.42.5(pid=14293): Launched 13:36:50.114631 run osmo-msc_10.42.42.6: Starting osmo-msc 13:36:50.691249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14295): Launched 13:36:51.009607 run osmo-msc_10.42.42.6(pid=14296): Launched 13:36:51.188132 run osmo-stp_10.42.42.5(pid=14293): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14293)] 13:36:51.323697 run osmo-stp_10.42.42.5(pid=14293): stdout: | (launched: 2022-12-10_13:36:49.934454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:51.459251 run osmo-stp_10.42.42.5(pid=14293): stderr: | [0;m[38;5;43m20221210133650125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133650125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133650125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133650126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133650126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133650126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133650126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:51.594431 run osmo-stp_10.42.42.5(pid=14293): stdout: | (launched: 2022-12-10_13:36:49.934454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:51.720676 run osmo-stp_10.42.42.5(pid=14293): stderr: | [0;m[38;5;43m20221210133650125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133650125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133650125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133650126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133650126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133650126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133650126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:51.874148 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14293): Process ended prematurely: osmo-stp_10.42.42.5(pid=14293) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14293)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:36:51.883691 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:36:51.911577 run osmo-hlr_10.42.42.2(pid=14290): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14290)] 13:36:51.961261 run osmo-hlr_10.42.42.2(pid=14290): stdout: | (launched: 2022-12-10_13:36:48.938507) 13:36:52.012114 run osmo-hlr_10.42.42.2(pid=14290): stderr: | [0;m[1;31m20221210133649137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133649137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133649137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133649137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133649137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133649137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133649149 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133649157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133649157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133649158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:52.083576 run osmo-msc_10.42.42.6(pid=14296): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14296)] 13:36:52.132845 run osmo-msc_10.42.42.6(pid=14296): stdout: | (launched: 2022-12-10_13:36:50.951869) 13:36:52.183906 run osmo-msc_10.42.42.6(pid=14296): stderr: | [0;m[38;5;43m20221210133651274 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133651274 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f322c769c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133651274 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133651274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133651274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133651274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133651276 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133651277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133651277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133651277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:36:52.235379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14289): Terminating (SIGTERM) 13:36:52.276367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14292): Terminating (SIGTERM) 13:36:52.317558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14295): Terminating (SIGTERM) 13:36:52.359046 --- ParallelTerminationStrategy: PID 14289 died... 13:36:52.378733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14289): Terminated: ok {rc=0} 13:36:52.425064 --- ParallelTerminationStrategy: PID 14292 died... 13:36:52.444384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14292): Terminated: ok {rc=0} 13:36:52.490892 --- ParallelTerminationStrategy: PID 14295 died... 13:36:52.510390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14295): Terminated: ok {rc=0} 13:36:52.598375 bus /sierra_3: Setting Powered False 13:36:53.697309 bus /sierra_3: Setting Powered False 13:36:54.812776 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:36:55.961209 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:36:55.973552 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:36:56.039406 tst mo_mt_call_osmux.py: using LAC 28762 13:36:56.165331 tst mo_mt_call_osmux.py: using RAC 202 13:36:56.292416 tst mo_mt_call_osmux.py: using CellId 28762 13:36:56.417316 tst mo_mt_call_osmux.py: using BVCI 28763 13:36:56.535678 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:36:56.547480 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:36:56.559014 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:36:56.570863 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:36:56.582770 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:36:56.594583 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:36:56.710906 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:36:56.826971 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:57.323756 run create_hlr_db(pid=14298): Launched 13:36:57.445382 bus /sierra_2: Setting Powered False 13:36:58.508668 run create_hlr_db(pid=14298): Terminated: ok {rc=0} 13:36:58.953239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14300): Launched 13:36:59.271936 run osmo-hlr_10.42.42.2(pid=14301): Launched 13:36:59.394549 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:59.949027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14303): Launched 13:37:00.268937 run osmo-stp_10.42.42.5(pid=14304): Launched 13:37:00.391834 run osmo-msc_10.42.42.6: Starting osmo-msc 13:37:00.999270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14306): Launched 13:37:01.334342 run osmo-msc_10.42.42.6(pid=14307): Launched 13:37:01.676072 run osmo-stp_10.42.42.5(pid=14304): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14304)] 13:37:02.046248 run osmo-stp_10.42.42.5(pid=14304): stdout: | (launched: 2022-12-10_13:37:00.210483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:02.403945 run osmo-stp_10.42.42.5(pid=14304): stderr: | [0;m[38;5;43m20221210133700402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133700402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133700402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133700402 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133700405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133700405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133700405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:02.538066 run osmo-stp_10.42.42.5(pid=14304): stdout: | (launched: 2022-12-10_13:37:00.210483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:02.664850 run osmo-stp_10.42.42.5(pid=14304): stderr: | [0;m[38;5;43m20221210133700402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133700402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133700402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133700402 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133700405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133700405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133700405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:02.816789 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14304): Process ended prematurely: osmo-stp_10.42.42.5(pid=14304) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14304)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:37:02.826357 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 13:37:02.854555 run osmo-hlr_10.42.42.2(pid=14301): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14301)] 13:37:02.904698 run osmo-hlr_10.42.42.2(pid=14301): stdout: | (launched: 2022-12-10_13:36:59.213692) 13:37:02.956302 run osmo-hlr_10.42.42.2(pid=14301): stderr: | [0;m[1;31m20221210133659409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133659409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133659409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133659409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133659410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133659410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133659422 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133659432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133659432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133659432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:03.028475 run osmo-msc_10.42.42.6(pid=14307): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14307)] 13:37:03.078476 run osmo-msc_10.42.42.6(pid=14307): stdout: | (launched: 2022-12-10_13:37:01.270596) 13:37:03.130101 run osmo-msc_10.42.42.6(pid=14307): stderr: | [0;m[38;5;43m20221210133702037 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133702038 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efdb389fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133702039 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133702039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133702040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133702040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133702045 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133702046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133702046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133702046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:37:03.182038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14300): Terminating (SIGTERM) 13:37:03.223311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14303): Terminating (SIGTERM) 13:37:03.264761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14306): Terminating (SIGTERM) 13:37:03.306792 --- ParallelTerminationStrategy: PID 14300 died... 13:37:03.326704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14300): Terminated: ok {rc=0} 13:37:03.373588 --- ParallelTerminationStrategy: PID 14303 died... 13:37:03.393223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14303): Terminated: ok {rc=0} 13:37:03.439642 --- ParallelTerminationStrategy: PID 14306 died... 13:37:03.459229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14306): Terminated: ok {rc=0} 13:37:03.547908 bus /sierra_3: Setting Powered False 13:37:04.646550 bus /sierra_3: Setting Powered False 13:37:05.761733 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:37:07.010769 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:37:07.016711 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:37:07.046865 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:37:07.073812 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:37:07.124911 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:37:07.154312 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:37:07.181341 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:37:07.732837 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:37:07.784235 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:37:07.795544 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:37:07.862224 tst mo_mt_call.py: using LAC 28763 13:37:07.989662 tst mo_mt_call.py: using RAC 203 13:37:08.117462 tst mo_mt_call.py: using CellId 28763 13:37:08.236466 tst mo_mt_call.py: using BVCI 28764 13:37:08.347289 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:37:08.358289 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:37:08.369128 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:37:08.380014 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:37:08.390970 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:37:08.401791 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:37:08.518121 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:37:08.634612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:09.099206 run create_hlr_db(pid=14312): Launched 13:37:09.220403 bus /sierra_2: Setting Powered False 13:37:10.280344 run create_hlr_db(pid=14312): Terminated: ok {rc=0} 13:37:10.715548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14314): Launched 13:37:11.033657 run osmo-hlr_10.42.42.2(pid=14315): Launched 13:37:11.156187 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:11.708471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14317): Launched 13:37:12.027328 run osmo-stp_10.42.42.5(pid=14318): Launched 13:37:12.149670 run osmo-msc_10.42.42.6: Starting osmo-msc 13:37:12.725590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14320): Launched 13:37:13.045419 run osmo-msc_10.42.42.6(pid=14321): Launched 13:37:13.224025 run osmo-stp_10.42.42.5(pid=14318): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14318)] 13:37:13.359698 run osmo-stp_10.42.42.5(pid=14318): stdout: | (launched: 2022-12-10_13:37:11.969607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:13.496512 run osmo-stp_10.42.42.5(pid=14318): stderr: | [0;m[38;5;43m20221210133712160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133712160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133712160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133712160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133712161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133712161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133712161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:13.631511 run osmo-stp_10.42.42.5(pid=14318): stdout: | (launched: 2022-12-10_13:37:11.969607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:13.758536 run osmo-stp_10.42.42.5(pid=14318): stderr: | [0;m[38;5;43m20221210133712160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133712160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133712160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133712160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133712161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133712161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133712161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:13.911171 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14318): Process ended prematurely: osmo-stp_10.42.42.5(pid=14318) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14318)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:37:13.920480 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:37:13.948826 run osmo-hlr_10.42.42.2(pid=14315): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14315)] 13:37:13.998628 run osmo-hlr_10.42.42.2(pid=14315): stdout: | (launched: 2022-12-10_13:37:10.976248) 13:37:14.050017 run osmo-hlr_10.42.42.2(pid=14315): stderr: | [0;m[1;31m20221210133711172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133711172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133711172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133711172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133711172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133711172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133711184 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133711192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133711192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133711192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:14.121920 run osmo-msc_10.42.42.6(pid=14321): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14321)] 13:37:14.171660 run osmo-msc_10.42.42.6(pid=14321): stdout: | (launched: 2022-12-10_13:37:12.987325) 13:37:14.223029 run osmo-msc_10.42.42.6(pid=14321): stderr: | [0;m[38;5;43m20221210133713307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133713307 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa82acdfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133713307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133713307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133713307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133713307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133713309 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133713310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133713310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133713310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:37:14.274656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14314): Terminating (SIGTERM) 13:37:14.316006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14317): Terminating (SIGTERM) 13:37:14.357561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14320): Terminating (SIGTERM) 13:37:14.399362 --- ParallelTerminationStrategy: PID 14314 died... 13:37:14.419073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14314): Terminated: ok {rc=0} 13:37:14.465237 --- ParallelTerminationStrategy: PID 14317 died... 13:37:14.484425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14317): Terminated: ok {rc=0} 13:37:14.530856 --- ParallelTerminationStrategy: PID 14320 died... 13:37:14.550283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14320): Terminated: ok {rc=0} 13:37:14.637779 bus /sierra_3: Setting Powered False 13:37:15.733925 bus /sierra_3: Setting Powered False 13:37:16.848026 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:37:17.991243 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:37:18.002749 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:37:18.067739 tst mo_mt_call_osmux.py: using LAC 28764 13:37:18.184897 tst mo_mt_call_osmux.py: using RAC 204 13:37:18.302608 tst mo_mt_call_osmux.py: using CellId 28764 13:37:18.421839 tst mo_mt_call_osmux.py: using BVCI 28765 13:37:18.530212 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:37:18.541131 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:37:18.551796 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:37:18.562610 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:37:18.573485 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:37:18.584423 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:37:18.703923 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:37:18.820547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:19.284024 run create_hlr_db(pid=14323): Launched 13:37:19.406480 bus /sierra_2: Setting Powered False 13:37:20.466040 run create_hlr_db(pid=14323): Terminated: ok {rc=0} 13:37:20.902296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14325): Launched 13:37:21.221188 run osmo-hlr_10.42.42.2(pid=14326): Launched 13:37:21.343758 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:21.895884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14328): Launched 13:37:22.199718 run osmo-stp_10.42.42.5(pid=14329): Launched 13:37:22.314079 run osmo-msc_10.42.42.6: Starting osmo-msc 13:37:22.853599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14331): Launched 13:37:23.152840 run osmo-msc_10.42.42.6(pid=14332): Launched 13:37:23.319681 run osmo-stp_10.42.42.5(pid=14329): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14329)] 13:37:23.446365 run osmo-stp_10.42.42.5(pid=14329): stdout: | (launched: 2022-12-10_13:37:22.144646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:23.572768 run osmo-stp_10.42.42.5(pid=14329): stderr: | [0;m[38;5;43m20221210133722315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133722315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133722315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133722316 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133722316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133722316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133722316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:23.696595 run osmo-stp_10.42.42.5(pid=14329): stdout: | (launched: 2022-12-10_13:37:22.144646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:23.814716 run osmo-stp_10.42.42.5(pid=14329): stderr: | [0;m[38;5;43m20221210133722315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133722315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133722315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133722316 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133722316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133722316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133722316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:23.956031 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14329): Process ended prematurely: osmo-stp_10.42.42.5(pid=14329) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14329)] [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:37:23.964758 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:37:23.991104 run osmo-hlr_10.42.42.2(pid=14326): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14326)] 13:37:24.038475 run osmo-hlr_10.42.42.2(pid=14326): stdout: | (launched: 2022-12-10_13:37:21.162997) 13:37:24.087164 run osmo-hlr_10.42.42.2(pid=14326): stderr: | [0;m[1;31m20221210133721363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133721363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133721363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133721363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133721363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133721363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133721375 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133721383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133721383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133721383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:24.155341 run osmo-msc_10.42.42.6(pid=14332): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14332)] 13:37:24.202232 run osmo-msc_10.42.42.6(pid=14332): stdout: | (launched: 2022-12-10_13:37:23.098016) 13:37:24.250773 run osmo-msc_10.42.42.6(pid=14332): stderr: | [0;m[38;5;43m20221210133723370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133723370 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f75d3c86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133723370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133723370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133723370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133723371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133723374 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133723374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133723375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133723375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:37:24.299536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14325): Terminating (SIGTERM) 13:37:24.338330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14328): Terminating (SIGTERM) 13:37:24.377846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14331): Terminating (SIGTERM) 13:37:24.417439 --- ParallelTerminationStrategy: PID 14325 died... 13:37:24.436147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14325): Terminated: ok {rc=0} 13:37:24.479271 --- ParallelTerminationStrategy: PID 14328 died... 13:37:24.497544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14328): Terminated: ok {rc=0} 13:37:24.540485 --- ParallelTerminationStrategy: PID 14331 died... 13:37:24.558822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14331): Terminated: ok {rc=0} 13:37:24.640646 bus /sierra_3: Setting Powered False 13:37:25.736514 bus /sierra_3: Setting Powered False 13:37:26.850370 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 13:37:28.091840 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:37:28.096494 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:37:28.126965 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:37:28.154192 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 13:37:28.238250 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:37:28.267981 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:37:28.295179 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 13:37:28.880874 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2375 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 13:37:28.886011 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:37:28.897191 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:37:28.942986 tst emergency_mo_mt_call.py: using LAC 28765 13:37:29.067550 tst emergency_mo_mt_call.py: using RAC 205 13:37:29.191767 tst emergency_mo_mt_call.py: using CellId 28765 13:37:29.313866 tst emergency_mo_mt_call.py: using BVCI 28766 13:37:29.427474 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:37:29.438671 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:37:29.449655 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:37:29.460809 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:37:29.472013 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:37:29.483159 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:37:29.596711 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:37:29.713605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:30.198128 run create_hlr_db(pid=14337): Launched 13:37:30.317905 bus /sierra_2: Setting Powered False 13:37:31.379914 run create_hlr_db(pid=14337): Terminated: ok {rc=0} 13:37:31.840816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14339): Launched 13:37:32.169702 run osmo-hlr_10.42.42.2(pid=14340): Launched 13:37:32.298301 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:32.805666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14342): Launched 13:37:33.100035 run osmo-stp_10.42.42.5(pid=14343): Launched 13:37:33.220688 tst emergency_mo_mt_call.py: using MSISDN 7759 13:37:33.386068 run osmo-msc_10.42.42.6: Starting osmo-msc 13:37:33.916172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14345): Launched 13:37:34.209554 run osmo-msc_10.42.42.6(pid=14346): Launched 13:37:34.374409 run osmo-stp_10.42.42.5(pid=14343): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14343)] 13:37:34.498738 run osmo-stp_10.42.42.5(pid=14343): stdout: | (launched: 2022-12-10_13:37:33.046244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:34.623128 run osmo-stp_10.42.42.5(pid=14343): stderr: | [0;m[38;5;43m20221210133733215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133733215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133733215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133733216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133733216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133733216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133733216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:34.745822 run osmo-stp_10.42.42.5(pid=14343): stdout: | (launched: 2022-12-10_13:37:33.046244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:34.862439 run osmo-stp_10.42.42.5(pid=14343): stderr: | [0;m[38;5;43m20221210133733215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133733215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133733215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133733216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133733216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133733216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133733216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:35.002151 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=14343): Process ended prematurely: osmo-stp_10.42.42.5(pid=14343) [trial-2375↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14343)] [trial-2375↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 13:37:35.010382 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 13:37:35.036604 run osmo-hlr_10.42.42.2(pid=14340): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14340)] 13:37:35.083813 run osmo-hlr_10.42.42.2(pid=14340): stdout: | (launched: 2022-12-10_13:37:32.101291) 13:37:35.132636 run osmo-hlr_10.42.42.2(pid=14340): stderr: | [0;m[1;31m20221210133732299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133732299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133732299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133732299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133732299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133732299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133732311 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133732321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133732322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133732322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:35.200735 run osmo-msc_10.42.42.6(pid=14346): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14346)] 13:37:35.247682 run osmo-msc_10.42.42.6(pid=14346): stdout: | (launched: 2022-12-10_13:37:34.155824) 13:37:35.295859 run osmo-msc_10.42.42.6(pid=14346): stderr: | [0;m[38;5;43m20221210133734429 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133734429 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc5a4abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133734429 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133734430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133734430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133734430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133734432 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133734432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133734432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133734432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:37:35.344549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14339): Terminating (SIGTERM) 13:37:35.383220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14342): Terminating (SIGTERM) 13:37:35.421831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14345): Terminating (SIGTERM) 13:37:35.461188 --- ParallelTerminationStrategy: PID 14339 died... 13:37:35.480049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14339): Terminated: ok {rc=0} 13:37:35.523577 --- ParallelTerminationStrategy: PID 14342 died... 13:37:35.542012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14342): Terminated: ok {rc=0} 13:37:35.584933 --- ParallelTerminationStrategy: PID 14345 died... 13:37:35.603323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14345): Terminated: ok {rc=0} 13:37:35.687487 bus /sierra_3: Setting Powered False 13:37:36.784164 bus /sierra_3: Setting Powered False 13:37:37.898195 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 13:37:38.984740 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:37:38.996207 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:37:39.043384 tst emergency_preemptive_call.py: using LAC 28766 13:37:39.161463 tst emergency_preemptive_call.py: using RAC 206 13:37:39.277457 tst emergency_preemptive_call.py: using CellId 28766 13:37:39.392594 tst emergency_preemptive_call.py: using BVCI 28767 13:37:39.499250 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:37:39.510344 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:37:39.520761 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:37:39.531807 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:37:39.542779 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:37:39.553808 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:37:39.667954 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:37:39.786037 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:37:39.904851 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:37:40.019785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:40.477236 run create_hlr_db(pid=14348): Launched 13:37:40.597112 bus /sierra_2: Setting Powered False 13:37:41.656465 run create_hlr_db(pid=14348): Terminated: ok {rc=0} 13:37:42.065327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14350): Launched 13:37:42.358747 run osmo-hlr_10.42.42.2(pid=14351): Launched 13:37:42.468839 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:42.989954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14353): Launched 13:37:43.283403 run osmo-stp_10.42.42.5(pid=14354): Launched 13:37:43.407026 tst emergency_preemptive_call.py: using MSISDN 7760 13:37:43.558381 run osmo-msc_10.42.42.6: Starting osmo-msc 13:37:44.085404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14356): Launched 13:37:44.379968 run osmo-msc_10.42.42.6(pid=14357): Launched 13:37:44.544039 run osmo-stp_10.42.42.5(pid=14354): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14354)] 13:37:44.668493 run osmo-stp_10.42.42.5(pid=14354): stdout: | (launched: 2022-12-10_13:37:43.229450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:44.793451 run osmo-stp_10.42.42.5(pid=14354): stderr: | [0;m[38;5;43m20221210133743396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133743396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133743396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133743397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133743398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133743398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133743398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:44.915559 run osmo-stp_10.42.42.5(pid=14354): stdout: | (launched: 2022-12-10_13:37:43.229450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:45.031983 run osmo-stp_10.42.42.5(pid=14354): stderr: | [0;m[38;5;43m20221210133743396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133743396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133743396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133743397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133743398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133743398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133743398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:45.171369 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14354): Process ended prematurely: osmo-stp_10.42.42.5(pid=14354) [trial-2375↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14354)] [trial-2375↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 13:37:45.179391 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 13:37:45.205340 run osmo-hlr_10.42.42.2(pid=14351): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14351)] 13:37:45.252938 run osmo-hlr_10.42.42.2(pid=14351): stdout: | (launched: 2022-12-10_13:37:42.305075) 13:37:45.301762 run osmo-hlr_10.42.42.2(pid=14351): stderr: | [0;m[1;31m20221210133742481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133742481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133742481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133742481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133742481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133742481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133742493 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133742504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133742504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133742504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:45.369921 run osmo-msc_10.42.42.6(pid=14357): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14357)] 13:37:45.416770 run osmo-msc_10.42.42.6(pid=14357): stdout: | (launched: 2022-12-10_13:37:44.325968) 13:37:45.465182 run osmo-msc_10.42.42.6(pid=14357): stderr: | [0;m[38;5;43m20221210133744597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210133744597 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb88d5f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210133744597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210133744597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210133744597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210133744598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210133744599 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210133744600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210133744600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210133744600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:37:45.513993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14350): Terminating (SIGTERM) 13:37:45.552730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14353): Terminating (SIGTERM) 13:37:45.591781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14356): Terminating (SIGTERM) 13:37:45.630938 --- ParallelTerminationStrategy: PID 14350 died... 13:37:45.649875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14350): Terminated: ok {rc=0} 13:37:45.693950 --- ParallelTerminationStrategy: PID 14353 died... 13:37:45.712491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14353): Terminated: ok {rc=0} 13:37:45.755814 --- ParallelTerminationStrategy: PID 14356 died... 13:37:45.774480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14356): Terminated: ok {rc=0} 13:37:45.891882 bus /sierra_9: Setting Powered False 13:37:46.993727 bus /sierra_9: Setting Powered False 13:37:48.111701 bus /sierra_8: Setting Powered False 13:37:49.209679 bus /sierra_8: Setting Powered False 13:37:50.319675 bus /sierra_3: Setting Powered False 13:37:51.418190 bus /sierra_3: Setting Powered False 13:37:52.534895 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 13:37:53.802285 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:37:53.806501 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:37:53.834892 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 13:37:53.872412 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 13:37:53.956450 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:37:53.984994 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 13:37:54.022925 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 13:37:54.615883 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 13:37:54.664414 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:37:54.674967 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:37:54.718350 tst cs_paging_gprs_active.py: using LAC 28767 13:37:54.835077 tst cs_paging_gprs_active.py: using RAC 207 13:37:54.956462 tst cs_paging_gprs_active.py: using CellId 28767 13:37:55.073062 tst cs_paging_gprs_active.py: using BVCI 28768 13:37:55.180772 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:37:55.191374 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:37:55.201711 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:37:55.212009 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:37:55.222419 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:37:55.232632 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:37:55.243114 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:37:55.253359 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:37:55.263773 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:37:55.380549 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:37:55.500082 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:37:55.716198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:56.037324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14362): Launched 13:37:56.313917 run iperf3-srv_10.42.42.10(pid=14363): Launched 13:37:56.433116 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:37:56.647790 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:56.968933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14364): Launched 13:37:57.245869 run iperf3-srv_10.42.42.10(pid=14365): Launched 13:37:57.365146 tst cs_paging_gprs_active.py:38: start network... 13:37:57.579322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:58.074131 run create_hlr_db(pid=14366): Launched 13:37:58.195631 bus /sierra_2: Setting Powered False 13:37:59.258427 run create_hlr_db(pid=14366): Terminated: ok {rc=0} 13:37:59.700371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14368): Launched 13:38:00.021645 run osmo-hlr_10.42.42.2(pid=14369): Launched 13:38:00.144048 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:00.699721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14371): Launched 13:38:01.054949 run osmo-stp_10.42.42.5(pid=14372): Launched 13:38:01.293395 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:38:01.883597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14374): Launched 13:38:02.002649 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:38:02.266573 run patchelf(pid=14375): Launched 13:38:02.456132 run osmo-stp_10.42.42.5(pid=14372): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14372)] 13:38:02.592088 run osmo-stp_10.42.42.5(pid=14372): stdout: | (launched: 2022-12-10_13:38:00.980175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:02.729467 run osmo-stp_10.42.42.5(pid=14372): stderr: | [0;m[38;5;43m20221210133801249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133801249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133801250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133801250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133801250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133801251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133801251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:02.866850 run osmo-stp_10.42.42.5(pid=14372): stdout: | (launched: 2022-12-10_13:38:00.980175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:02.999091 run osmo-stp_10.42.42.5(pid=14372): stderr: | [0;m[38;5;43m20221210133801249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133801249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133801250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133801250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133801250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133801251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133801251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:03.154477 run patchelf(pid=14375): Terminating (SIGINT) 13:38:03.333515 run patchelf(pid=14375): Terminated: ok {rc=0} 13:38:03.462691 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14372): Process ended prematurely: osmo-stp_10.42.42.5(pid=14372) [trial-2375↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14372)] [trial-2375↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 13:38:03.472810 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:38:03.503612 run osmo-hlr_10.42.42.2(pid=14369): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14369)] 13:38:03.551096 run osmo-hlr_10.42.42.2(pid=14369): stdout: | (launched: 2022-12-10_13:37:59.962869) 13:38:03.600338 run osmo-hlr_10.42.42.2(pid=14369): stderr: | [0;m[1;31m20221210133800160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133800160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133800160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133800160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133800160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133800160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133800172 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133800180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133800180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133800180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:03.649802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14362): Terminating (SIGTERM) 13:38:03.689609 run iperf3-srv_10.42.42.10(pid=14363): Terminating (SIGTERM) 13:38:03.729177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14364): Terminating (SIGTERM) 13:38:03.768812 run iperf3-srv_10.42.42.10(pid=14365): Terminating (SIGTERM) 13:38:03.808206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14368): Terminating (SIGTERM) 13:38:03.847908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14371): Terminating (SIGTERM) 13:38:03.887546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14374): Terminating (SIGTERM) 13:38:03.927576 --- ParallelTerminationStrategy: PID 14362 died... 13:38:03.946453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14362): Terminated: ok {rc=0} 13:38:03.991020 --- ParallelTerminationStrategy: PID 14363 died... 13:38:04.009256 run iperf3-srv_10.42.42.10(pid=14363): Terminated {rc=256} 13:38:04.053386 --- ParallelTerminationStrategy: PID 14364 died... 13:38:04.071886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14364): Terminated: ok {rc=0} 13:38:04.115549 --- ParallelTerminationStrategy: PID 14365 died... 13:38:04.133878 run iperf3-srv_10.42.42.10(pid=14365): Terminated {rc=256} 13:38:04.177353 --- ParallelTerminationStrategy: PID 14368 died... 13:38:04.195674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14368): Terminated: ok {rc=0} 13:38:04.238633 --- ParallelTerminationStrategy: PID 14371 died... 13:38:04.257061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14371): Terminated: ok {rc=0} 13:38:04.299868 --- ParallelTerminationStrategy: PID 14374 died... 13:38:04.318237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14374): Terminated: ok {rc=0} 13:38:04.402149 bus /gobi_0: Setting Powered False 13:38:05.500027 bus /gobi_0: Setting Powered False 13:38:06.610921 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 13:38:07.757196 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:07.768884 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:38:07.817432 tst iperf3.py: using LAC 28768 13:38:07.936262 tst iperf3.py: using RAC 208 13:38:08.060651 tst iperf3.py: using CellId 28768 13:38:08.177404 tst iperf3.py: using BVCI 28769 13:38:08.285865 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:08.296538 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:08.306987 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:08.317416 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:08.327760 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:08.338132 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:08.348716 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:08.359028 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:08.369903 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:38:08.487756 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:38:08.687454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:38:08.986694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14376): Launched 13:38:09.245700 run iperf3-srv_10.42.42.10(pid=14377): Launched 13:38:09.356701 tst iperf3.py:8: start network... 13:38:09.555840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:10.018140 run create_hlr_db(pid=14378): Launched 13:38:10.139144 bus /gobi_6: Setting Powered False 13:38:11.197973 run create_hlr_db(pid=14378): Terminated: ok {rc=0} 13:38:11.612027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14380): Launched 13:38:11.909064 run osmo-hlr_10.42.42.2(pid=14381): Launched 13:38:12.023152 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:12.539682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14383): Launched 13:38:12.837761 run osmo-stp_10.42.42.5(pid=14384): Launched 13:38:12.952343 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:38:13.468659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14386): Launched 13:38:13.581883 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:38:13.833267 run patchelf(pid=14387): Launched 13:38:13.998808 run osmo-stp_10.42.42.5(pid=14384): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14384)] 13:38:14.124630 run osmo-stp_10.42.42.5(pid=14384): stdout: | (launched: 2022-12-10_13:38:12.782582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:14.252176 run osmo-stp_10.42.42.5(pid=14384): stderr: | [0;m[38;5;43m20221210133812956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133812957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133812957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133812957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133812958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133812958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133812958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:14.379844 run osmo-stp_10.42.42.5(pid=14384): stdout: | (launched: 2022-12-10_13:38:12.782582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:14.502683 run osmo-stp_10.42.42.5(pid=14384): stderr: | [0;m[38;5;43m20221210133812956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133812957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133812957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133812957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133812958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133812958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133812958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:14.647108 run patchelf(pid=14387): Terminating (SIGINT) 13:38:14.814806 run patchelf(pid=14387): Terminated: ok {rc=0} 13:38:14.935549 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14384): Process ended prematurely: osmo-stp_10.42.42.5(pid=14384) [trial-2375↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14384)] [trial-2375↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 13:38:14.944713 tst iperf3.py:8: Test FAILED (7.2 sec) 13:38:14.971610 run osmo-hlr_10.42.42.2(pid=14381): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14381)] 13:38:15.018240 run osmo-hlr_10.42.42.2(pid=14381): stdout: | (launched: 2022-12-10_13:38:11.853872) 13:38:15.066321 run osmo-hlr_10.42.42.2(pid=14381): stderr: | [0;m[1;31m20221210133812028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133812028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133812028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133812028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133812028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133812028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133812040 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133812051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133812051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133812051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:15.115045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14376): Terminating (SIGTERM) 13:38:15.153780 run iperf3-srv_10.42.42.10(pid=14377): Terminating (SIGTERM) 13:38:15.192442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14380): Terminating (SIGTERM) 13:38:15.231262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14383): Terminating (SIGTERM) 13:38:15.270125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14386): Terminating (SIGTERM) 13:38:15.309397 --- ParallelTerminationStrategy: PID 14376 died... 13:38:15.327853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14376): Terminated: ok {rc=0} 13:38:15.371198 --- ParallelTerminationStrategy: PID 14377 died... 13:38:15.389590 run iperf3-srv_10.42.42.10(pid=14377): Terminated {rc=256} 13:38:15.432790 --- ParallelTerminationStrategy: PID 14380 died... 13:38:15.451191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14380): Terminated: ok {rc=0} 13:38:15.494582 --- ParallelTerminationStrategy: PID 14383 died... 13:38:15.513088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14383): Terminated: ok {rc=0} 13:38:15.556367 --- ParallelTerminationStrategy: PID 14386 died... 13:38:15.574928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14386): Terminated: ok {rc=0} 13:38:15.656922 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 13:38:16.862200 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:16.880853 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:38:16.937234 tst iperf3m4.py: using LAC 28769 13:38:17.119284 tst iperf3m4.py: using RAC 209 13:38:17.290804 tst iperf3m4.py: using CellId 28769 13:38:17.451046 tst iperf3m4.py: using BVCI 28770 13:38:17.616261 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:17.631268 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:17.651245 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:17.668128 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:17.683804 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:17.698736 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:17.716252 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:17.733924 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:17.749748 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:38:17.919681 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:38:18.057502 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:38:18.197264 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:38:18.350044 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:38:18.612583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:38:19.002931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14592): Launched 13:38:19.366728 run iperf3-srv_10.42.42.10(pid=14638): Launched 13:38:19.530682 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:38:19.771972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:38:20.121721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14660): Launched 13:38:20.409769 run iperf3-srv_10.42.42.10(pid=14661): Launched 13:38:20.538288 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:38:20.743575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:38:21.062316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14662): Launched 13:38:21.355672 run iperf3-srv_10.42.42.10(pid=14663): Launched 13:38:21.482557 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:38:21.686027 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:38:22.005715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14666): Launched 13:38:22.291005 run iperf3-srv_10.42.42.10(pid=14667): Launched 13:38:22.414451 tst iperf3m4.py:8: start network... 13:38:22.622974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:23.107567 run create_hlr_db(pid=14668): Launched 13:38:23.264488 bus /gobi_6: Setting Powered False 13:38:24.326359 run create_hlr_db(pid=14668): Terminated: ok {rc=0} 13:38:24.763271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14670): Launched 13:38:25.113666 run osmo-hlr_10.42.42.2(pid=14671): Launched 13:38:25.356555 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:26.137706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14673): Launched 13:38:26.477731 run osmo-stp_10.42.42.5(pid=14674): Launched 13:38:26.718738 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:38:27.361653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14676): Launched 13:38:27.488840 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:38:27.773746 run patchelf(pid=14677): Launched 13:38:27.959012 run osmo-stp_10.42.42.5(pid=14674): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14674)] 13:38:28.096318 run osmo-stp_10.42.42.5(pid=14674): stdout: | (launched: 2022-12-10_13:38:26.405796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:28.235396 run osmo-stp_10.42.42.5(pid=14674): stderr: | [0;m[38;5;43m20221210133826704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133826704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133826704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133826705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133826707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133826707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133826707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:28.374817 run osmo-stp_10.42.42.5(pid=14674): stdout: | (launched: 2022-12-10_13:38:26.405796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:28.508373 run osmo-stp_10.42.42.5(pid=14674): stderr: | [0;m[38;5;43m20221210133826704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133826704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133826704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133826705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133826707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133826707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133826707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:28.666970 run patchelf(pid=14677): Terminating (SIGINT) 13:38:28.848140 run patchelf(pid=14677): Terminated: ok {rc=0} 13:38:28.980310 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14674): Process ended prematurely: osmo-stp_10.42.42.5(pid=14674) [trial-2375↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14674)] [trial-2375↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 13:38:28.991484 tst iperf3m4.py:8: Test FAILED (12.2 sec) 13:38:29.023868 run osmo-hlr_10.42.42.2(pid=14671): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14671)] 13:38:29.076511 run osmo-hlr_10.42.42.2(pid=14671): stdout: | (launched: 2022-12-10_13:38:25.041412) 13:38:29.130588 run osmo-hlr_10.42.42.2(pid=14671): stderr: | [0;m[1;31m20221210133825357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133825357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133825358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133825358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133825358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133825358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133825371 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133825388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133825388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133825388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:29.185463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14592): Terminating (SIGTERM) 13:38:29.229801 run iperf3-srv_10.42.42.10(pid=14638): Terminating (SIGTERM) 13:38:29.276710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14660): Terminating (SIGTERM) 13:38:29.321423 run iperf3-srv_10.42.42.10(pid=14661): Terminating (SIGTERM) 13:38:29.368474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14662): Terminating (SIGTERM) 13:38:29.413385 run iperf3-srv_10.42.42.10(pid=14663): Terminating (SIGTERM) 13:38:29.460568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14666): Terminating (SIGTERM) 13:38:29.504864 run iperf3-srv_10.42.42.10(pid=14667): Terminating (SIGTERM) 13:38:29.550545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14670): Terminating (SIGTERM) 13:38:29.595592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14673): Terminating (SIGTERM) 13:38:29.642070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14676): Terminating (SIGTERM) 13:38:29.688684 --- ParallelTerminationStrategy: PID 14592 died... 13:38:29.709608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14592): Terminated: ok {rc=0} 13:38:29.760500 --- ParallelTerminationStrategy: PID 14638 died... 13:38:29.781170 run iperf3-srv_10.42.42.10(pid=14638): Terminated {rc=256} 13:38:29.830915 --- ParallelTerminationStrategy: PID 14660 died... 13:38:29.851743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14660): Terminated: ok {rc=0} 13:38:29.901474 --- ParallelTerminationStrategy: PID 14661 died... 13:38:29.922383 run iperf3-srv_10.42.42.10(pid=14661): Terminated {rc=256} 13:38:29.972265 --- ParallelTerminationStrategy: PID 14662 died... 13:38:29.992778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14662): Terminated: ok {rc=0} 13:38:30.042244 --- ParallelTerminationStrategy: PID 14663 died... 13:38:30.062738 run iperf3-srv_10.42.42.10(pid=14663): Terminated {rc=256} 13:38:30.112143 --- ParallelTerminationStrategy: PID 14666 died... 13:38:30.132622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14666): Terminated: ok {rc=0} 13:38:30.182040 --- ParallelTerminationStrategy: PID 14667 died... 13:38:30.202467 run iperf3-srv_10.42.42.10(pid=14667): Terminated {rc=256} 13:38:30.251780 --- ParallelTerminationStrategy: PID 14670 died... 13:38:30.272282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14670): Terminated: ok {rc=0} 13:38:30.321900 --- ParallelTerminationStrategy: PID 14673 died... 13:38:30.342214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14673): Terminated: ok {rc=0} 13:38:30.391661 --- ParallelTerminationStrategy: PID 14676 died... 13:38:30.412176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14676): Terminated: ok {rc=0} 13:38:30.504127 bus /gobi_4: Setting Powered False 13:38:31.624613 bus /gobi_4: Setting Powered False 13:38:32.770178 bus /gobi_1: Setting Powered False 13:38:33.866438 bus /gobi_1: Setting Powered False 13:38:34.983995 bus /gobi_0: Setting Powered False 13:38:36.084033 bus /gobi_0: Setting Powered False 13:38:37.199285 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 13:38:38.308756 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:38.321553 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:38:38.370518 tst ping.py: using LAC 28770 13:38:38.486765 tst ping.py: using RAC 210 13:38:38.607236 tst ping.py: using CellId 28770 13:38:38.723907 tst ping.py: using BVCI 28771 13:38:38.830472 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:38.841558 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:38.852457 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:38.863518 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:38.874541 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:38.886560 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:38.897565 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:38.908435 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:38:39.022434 tst ping.py:19: start network... 13:38:39.239608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:39.717131 run create_hlr_db(pid=14679): Launched 13:38:39.834023 bus /gobi_6: Setting Powered False 13:38:40.895111 run create_hlr_db(pid=14679): Terminated: ok {rc=0} 13:38:41.308378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14681): Launched 13:38:41.597306 run osmo-hlr_10.42.42.2(pid=14682): Launched 13:38:41.708092 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:42.207297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14684): Launched 13:38:42.496250 run osmo-stp_10.42.42.5(pid=14685): Launched 13:38:42.612089 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:38:43.110766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14687): Launched 13:38:43.221036 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:38:43.465355 run patchelf(pid=14688): Launched 13:38:43.627073 run osmo-stp_10.42.42.5(pid=14685): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14685)] 13:38:43.750245 run osmo-stp_10.42.42.5(pid=14685): stdout: | (launched: 2022-12-10_13:38:42.443071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:43.874507 run osmo-stp_10.42.42.5(pid=14685): stderr: | [0;m[38;5;43m20221210133842611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133842611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133842611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133842611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133842612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133842612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133842612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:43.999122 run osmo-stp_10.42.42.5(pid=14685): stdout: | (launched: 2022-12-10_13:38:42.443071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:44.118662 run osmo-stp_10.42.42.5(pid=14685): stderr: | [0;m[38;5;43m20221210133842611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133842611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133842611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133842611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133842612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133842612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133842612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:44.259893 run patchelf(pid=14688): Terminating (SIGINT) 13:38:44.423910 run patchelf(pid=14688): Terminated: ok {rc=0} 13:38:44.542014 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14685): Process ended prematurely: osmo-stp_10.42.42.5(pid=14685) [trial-2375↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14685)] [trial-2375↪gprs:trx-lms-limenet-micro↪ping.py:22] 13:38:44.550856 tst ping.py:22: Test FAILED (6.2 sec) 13:38:44.576899 run osmo-hlr_10.42.42.2(pid=14682): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14682)] 13:38:44.623552 run osmo-hlr_10.42.42.2(pid=14682): stdout: | (launched: 2022-12-10_13:38:41.543877) 13:38:44.672363 run osmo-hlr_10.42.42.2(pid=14682): stderr: | [0;m[1;31m20221210133841716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133841717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133841717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133841717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133841717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133841717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133841729 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133841738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133841738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133841738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:44.721271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14681): Terminating (SIGTERM) 13:38:44.760088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14684): Terminating (SIGTERM) 13:38:44.798897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14687): Terminating (SIGTERM) 13:38:44.837945 --- ParallelTerminationStrategy: PID 14681 died... 13:38:44.856364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14681): Terminated: ok {rc=0} 13:38:44.899397 --- ParallelTerminationStrategy: PID 14684 died... 13:38:44.917644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14684): Terminated: ok {rc=0} 13:38:44.960526 --- ParallelTerminationStrategy: PID 14687 died... 13:38:44.978635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14687): Terminated: ok {rc=0} 13:38:45.059746 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 13:38:46.143394 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:46.158396 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:38:46.210334 tst ping_idle_ping.py: using LAC 28771 13:38:46.390779 tst ping_idle_ping.py: using RAC 211 13:38:46.511979 tst ping_idle_ping.py: using CellId 28771 13:38:46.635821 tst ping_idle_ping.py: using BVCI 28772 13:38:46.752741 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:46.764766 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:46.776817 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:46.791123 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:46.803920 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:46.815776 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:46.828567 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:38:46.842698 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:38:46.962964 tst ping_idle_ping.py:24: start network... 13:38:47.162796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:47.616656 run create_hlr_db(pid=14689): Launched 13:38:47.736267 bus /gobi_6: Setting Powered False 13:38:48.794996 run create_hlr_db(pid=14689): Terminated: ok {rc=0} 13:38:49.220153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14691): Launched 13:38:49.530570 run osmo-hlr_10.42.42.2(pid=14692): Launched 13:38:49.649861 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:50.188630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14694): Launched 13:38:50.499017 run osmo-stp_10.42.42.5(pid=14695): Launched 13:38:50.617307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:38:51.152492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14697): Launched 13:38:51.267883 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:38:51.513969 run patchelf(pid=14698): Launched 13:38:51.676041 run osmo-stp_10.42.42.5(pid=14695): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14695)] 13:38:51.799625 run osmo-stp_10.42.42.5(pid=14695): stdout: | (launched: 2022-12-10_13:38:50.442676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:51.925145 run osmo-stp_10.42.42.5(pid=14695): stderr: | [0;m[38;5;43m20221210133850633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133850633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133850633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133850634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133850634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133850634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133850634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:52.050286 run osmo-stp_10.42.42.5(pid=14695): stdout: | (launched: 2022-12-10_13:38:50.442676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:52.170450 run osmo-stp_10.42.42.5(pid=14695): stderr: | [0;m[38;5;43m20221210133850633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133850633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133850633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133850634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133850634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133850634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133850634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:52.313151 run patchelf(pid=14698): Terminating (SIGINT) 13:38:52.477222 run patchelf(pid=14698): Terminated: ok {rc=0} 13:38:52.595709 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14695): Process ended prematurely: osmo-stp_10.42.42.5(pid=14695) [trial-2375↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14695)] [trial-2375↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 13:38:52.604299 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:38:52.630260 run osmo-hlr_10.42.42.2(pid=14692): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14692)] 13:38:52.676892 run osmo-hlr_10.42.42.2(pid=14692): stdout: | (launched: 2022-12-10_13:38:49.474401) 13:38:52.725579 run osmo-hlr_10.42.42.2(pid=14692): stderr: | [0;m[1;31m20221210133849671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133849671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133849671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133849671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133849671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133849671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133849685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133849693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133849693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133849693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:52.774704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14691): Terminating (SIGTERM) 13:38:52.813840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14694): Terminating (SIGTERM) 13:38:52.853344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14697): Terminating (SIGTERM) 13:38:52.893212 --- ParallelTerminationStrategy: PID 14691 died... 13:38:52.911766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14691): Terminated: ok {rc=0} 13:38:52.954966 --- ParallelTerminationStrategy: PID 14694 died... 13:38:52.973234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14694): Terminated: ok {rc=0} 13:38:53.016649 --- ParallelTerminationStrategy: PID 14697 died... 13:38:53.034918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14697): Terminated: ok {rc=0} 13:38:53.118303 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 13:38:54.408872 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:54.414443 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:38:54.443375 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:38:54.480726 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:38:54.566493 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:38:54.595262 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:38:54.632514 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:38:55.225740 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:38:55.273453 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:38:55.284277 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:38:55.329766 tst cs_paging_gprs_active.py: using LAC 28772 13:38:55.450993 tst cs_paging_gprs_active.py: using RAC 212 13:38:55.567315 tst cs_paging_gprs_active.py: using CellId 28772 13:38:55.682811 tst cs_paging_gprs_active.py: using BVCI 28773 13:38:55.791803 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:38:55.802587 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:38:55.813139 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:38:55.823920 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:38:55.834616 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:38:55.845310 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:38:55.856000 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:38:55.866777 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:38:55.877861 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:38:55.989553 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:38:56.108588 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:38:56.307075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:38:56.603409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14702): Launched 13:38:56.861224 run iperf3-srv_10.42.42.10(pid=14703): Launched 13:38:56.971986 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:38:57.168763 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:38:57.464311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14704): Launched 13:38:57.721017 run iperf3-srv_10.42.42.10(pid=14705): Launched 13:38:57.831249 tst cs_paging_gprs_active.py:38: start network... 13:38:58.028581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:58.487500 run create_hlr_db(pid=14706): Launched 13:38:58.609041 bus /gobi_6: Setting Powered False 13:38:59.668731 run create_hlr_db(pid=14706): Terminated: ok {rc=0} 13:39:00.100570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14708): Launched 13:39:00.415469 run osmo-hlr_10.42.42.2(pid=14709): Launched 13:39:00.536568 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:01.118861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14711): Launched 13:39:01.483065 run osmo-stp_10.42.42.5(pid=14712): Launched 13:39:01.824739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:39:02.414388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14714): Launched 13:39:02.534969 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:39:02.801588 run patchelf(pid=14715): Launched 13:39:02.978202 run osmo-stp_10.42.42.5(pid=14712): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14712)] 13:39:03.112673 run osmo-stp_10.42.42.5(pid=14712): stdout: | (launched: 2022-12-10_13:39:01.419983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:03.248849 run osmo-stp_10.42.42.5(pid=14712): stderr: | [0;m[38;5;43m20221210133901651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133901651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133901651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133901652 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133901653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133901653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133901653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:03.385035 run osmo-stp_10.42.42.5(pid=14712): stdout: | (launched: 2022-12-10_13:39:01.419983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:03.515211 run osmo-stp_10.42.42.5(pid=14712): stderr: | [0;m[38;5;43m20221210133901651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133901651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133901651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133901652 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133901653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133901653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133901653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:03.669697 run patchelf(pid=14715): Terminating (SIGINT) 13:39:03.847552 run patchelf(pid=14715): Terminated: ok {rc=0} 13:39:03.976491 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14712): Process ended prematurely: osmo-stp_10.42.42.5(pid=14712) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14712)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:39:03.986575 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:39:04.015156 run osmo-hlr_10.42.42.2(pid=14709): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14709)] 13:39:04.064819 run osmo-hlr_10.42.42.2(pid=14709): stdout: | (launched: 2022-12-10_13:39:00.358407) 13:39:04.116287 run osmo-hlr_10.42.42.2(pid=14709): stderr: | [0;m[1;31m20221210133900553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133900553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133900554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133900554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133900554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133900554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133900566 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133900574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133900575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133900575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:04.168348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14702): Terminating (SIGTERM) 13:39:04.209937 run iperf3-srv_10.42.42.10(pid=14703): Terminating (SIGTERM) 13:39:04.251425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14704): Terminating (SIGTERM) 13:39:04.293120 run iperf3-srv_10.42.42.10(pid=14705): Terminating (SIGTERM) 13:39:04.334383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14708): Terminating (SIGTERM) 13:39:04.375977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14711): Terminating (SIGTERM) 13:39:04.417539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14714): Terminating (SIGTERM) 13:39:04.459423 --- ParallelTerminationStrategy: PID 14702 died... 13:39:04.479082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14702): Terminated: ok {rc=0} 13:39:04.524813 --- ParallelTerminationStrategy: PID 14703 died... 13:39:04.543909 run iperf3-srv_10.42.42.10(pid=14703): Terminated {rc=256} 13:39:04.589651 --- ParallelTerminationStrategy: PID 14704 died... 13:39:04.608852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14704): Terminated: ok {rc=0} 13:39:04.654431 --- ParallelTerminationStrategy: PID 14705 died... 13:39:04.673632 run iperf3-srv_10.42.42.10(pid=14705): Terminated {rc=256} 13:39:04.719218 --- ParallelTerminationStrategy: PID 14708 died... 13:39:04.738601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14708): Terminated: ok {rc=0} 13:39:04.784302 --- ParallelTerminationStrategy: PID 14711 died... 13:39:04.803702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14711): Terminated: ok {rc=0} 13:39:04.849713 --- ParallelTerminationStrategy: PID 14714 died... 13:39:04.868924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14714): Terminated: ok {rc=0} 13:39:04.955585 bus /gobi_0: Setting Powered False 13:39:06.052301 bus /gobi_0: Setting Powered False 13:39:07.166224 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:39:08.312128 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:08.324111 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:39:08.371885 tst iperf3.py: using LAC 28773 13:39:08.498357 tst iperf3.py: using RAC 213 13:39:08.623972 tst iperf3.py: using CellId 28773 13:39:08.748772 tst iperf3.py: using BVCI 28774 13:39:08.864726 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:08.876082 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:08.887240 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:08.898617 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:08.910020 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:08.921693 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:08.933195 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:08.944415 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:08.956062 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:39:09.074262 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:39:09.286595 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:39:09.602403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14716): Launched 13:39:09.875554 run iperf3-srv_10.42.42.10(pid=14717): Launched 13:39:09.994627 tst iperf3.py:8: start network... 13:39:10.207011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:10.693698 run create_hlr_db(pid=14718): Launched 13:39:10.814994 bus /gobi_6: Setting Powered False 13:39:11.877280 run create_hlr_db(pid=14718): Terminated: ok {rc=0} 13:39:12.299575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14720): Launched 13:39:12.594390 run osmo-hlr_10.42.42.2(pid=14721): Launched 13:39:12.706494 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:13.229574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14723): Launched 13:39:13.526299 run osmo-stp_10.42.42.5(pid=14724): Launched 13:39:13.639115 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:39:14.148196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14726): Launched 13:39:14.260469 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:39:14.509511 run patchelf(pid=14727): Launched 13:39:14.672599 run osmo-stp_10.42.42.5(pid=14724): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14724)] 13:39:14.796878 run osmo-stp_10.42.42.5(pid=14724): stdout: | (launched: 2022-12-10_13:39:13.471844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:14.924054 run osmo-stp_10.42.42.5(pid=14724): stderr: | [0;m[38;5;43m20221210133913642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133913642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133913643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133913643 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133913643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133913643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133913644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:15.050623 run osmo-stp_10.42.42.5(pid=14724): stdout: | (launched: 2022-12-10_13:39:13.471844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:15.171690 run osmo-stp_10.42.42.5(pid=14724): stderr: | [0;m[38;5;43m20221210133913642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133913642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133913643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133913643 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133913643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133913643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133913644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:15.314765 run patchelf(pid=14727): Terminating (SIGINT) 13:39:15.481386 run patchelf(pid=14727): Terminated: ok {rc=0} 13:39:15.601102 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14724): Process ended prematurely: osmo-stp_10.42.42.5(pid=14724) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14724)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 13:39:15.610277 tst iperf3.py:8: Test FAILED (7.3 sec) 13:39:15.636536 run osmo-hlr_10.42.42.2(pid=14721): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14721)] 13:39:15.683317 run osmo-hlr_10.42.42.2(pid=14721): stdout: | (launched: 2022-12-10_13:39:12.540378) 13:39:15.731637 run osmo-hlr_10.42.42.2(pid=14721): stderr: | [0;m[1;31m20221210133912717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133912717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133912718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133912718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133912718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133912718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133912730 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133912738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133912739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133912739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:15.780472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14716): Terminating (SIGTERM) 13:39:15.819326 run iperf3-srv_10.42.42.10(pid=14717): Terminating (SIGTERM) 13:39:15.883304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14720): Terminating (SIGTERM) 13:39:15.935705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14723): Terminating (SIGTERM) 13:39:15.981398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14726): Terminating (SIGTERM) 13:39:16.027525 --- ParallelTerminationStrategy: PID 14716 died... 13:39:16.048213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14716): Terminated: ok {rc=0} 13:39:16.099506 --- ParallelTerminationStrategy: PID 14717 died... 13:39:16.119811 run iperf3-srv_10.42.42.10(pid=14717): Terminated {rc=256} 13:39:16.168845 --- ParallelTerminationStrategy: PID 14720 died... 13:39:16.189399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14720): Terminated: ok {rc=0} 13:39:16.239084 --- ParallelTerminationStrategy: PID 14723 died... 13:39:16.259529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14723): Terminated: ok {rc=0} 13:39:16.309998 --- ParallelTerminationStrategy: PID 14726 died... 13:39:16.331610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14726): Terminated: ok {rc=0} 13:39:16.423090 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:39:17.572229 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:17.584345 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:39:17.632818 tst iperf3m4.py: using LAC 28774 13:39:17.758819 tst iperf3m4.py: using RAC 214 13:39:17.884146 tst iperf3m4.py: using CellId 28774 13:39:18.002703 tst iperf3m4.py: using BVCI 28775 13:39:18.111981 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:18.122869 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:18.133639 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:18.144672 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:18.155760 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:18.166906 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:18.178144 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:18.189287 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:18.200400 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:39:18.320326 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:39:18.434722 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:39:18.551376 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:39:18.670241 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:39:18.882295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:39:19.198164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14728): Launched 13:39:19.470987 run iperf3-srv_10.42.42.10(pid=14729): Launched 13:39:19.589146 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:39:19.801403 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:39:20.116927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14730): Launched 13:39:20.389928 run iperf3-srv_10.42.42.10(pid=14731): Launched 13:39:20.507752 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:39:20.719478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:39:21.035149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14732): Launched 13:39:21.308397 run iperf3-srv_10.42.42.10(pid=14733): Launched 13:39:21.426248 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:39:21.638042 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:39:21.953554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14734): Launched 13:39:22.226775 run iperf3-srv_10.42.42.10(pid=14735): Launched 13:39:22.344184 tst iperf3m4.py:8: start network... 13:39:22.555940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:23.043727 run create_hlr_db(pid=14736): Launched 13:39:23.164768 bus /gobi_6: Setting Powered False 13:39:24.227268 run create_hlr_db(pid=14736): Terminated: ok {rc=0} 13:39:24.664375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14738): Launched 13:39:24.978342 run osmo-hlr_10.42.42.2(pid=14739): Launched 13:39:25.098763 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:25.644772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14741): Launched 13:39:25.961143 run osmo-stp_10.42.42.5(pid=14742): Launched 13:39:26.082568 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:39:26.627496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14744): Launched 13:39:26.747912 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:39:27.013864 run patchelf(pid=14745): Launched 13:39:27.188479 run osmo-stp_10.42.42.5(pid=14742): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14742)] 13:39:27.321865 run osmo-stp_10.42.42.5(pid=14742): stdout: | (launched: 2022-12-10_13:39:25.903053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:27.457081 run osmo-stp_10.42.42.5(pid=14742): stderr: | [0;m[38;5;43m20221210133926093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133926093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133926094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133926094 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133926094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133926094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133926095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:27.592854 run osmo-stp_10.42.42.5(pid=14742): stdout: | (launched: 2022-12-10_13:39:25.903053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:27.722377 run osmo-stp_10.42.42.5(pid=14742): stderr: | [0;m[38;5;43m20221210133926093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133926093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133926094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133926094 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133926094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133926094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133926095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:27.875815 run patchelf(pid=14745): Terminating (SIGINT) 13:39:28.053663 run patchelf(pid=14745): Terminated: ok {rc=0} 13:39:28.181264 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14742): Process ended prematurely: osmo-stp_10.42.42.5(pid=14742) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14742)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 13:39:28.191634 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:39:28.220510 run osmo-hlr_10.42.42.2(pid=14739): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14739)] 13:39:28.269955 run osmo-hlr_10.42.42.2(pid=14739): stdout: | (launched: 2022-12-10_13:39:24.921287) 13:39:28.321336 run osmo-hlr_10.42.42.2(pid=14739): stderr: | [0;m[1;31m20221210133925116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133925116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133925117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133925117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133925117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133925117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133925128 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133925137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133925137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133925137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:28.373449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14728): Terminating (SIGTERM) 13:39:28.415140 run iperf3-srv_10.42.42.10(pid=14729): Terminating (SIGTERM) 13:39:28.456816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14730): Terminating (SIGTERM) 13:39:28.498556 run iperf3-srv_10.42.42.10(pid=14731): Terminating (SIGTERM) 13:39:28.540147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14732): Terminating (SIGTERM) 13:39:28.582046 run iperf3-srv_10.42.42.10(pid=14733): Terminating (SIGTERM) 13:39:28.623562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14734): Terminating (SIGTERM) 13:39:28.665450 run iperf3-srv_10.42.42.10(pid=14735): Terminating (SIGTERM) 13:39:28.706991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14738): Terminating (SIGTERM) 13:39:28.748597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14741): Terminating (SIGTERM) 13:39:28.790284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14744): Terminating (SIGTERM) 13:39:28.832170 --- ParallelTerminationStrategy: PID 14728 died... 13:39:28.851919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14728): Terminated: ok {rc=0} 13:39:28.898296 --- ParallelTerminationStrategy: PID 14729 died... 13:39:28.917601 run iperf3-srv_10.42.42.10(pid=14729): Terminated {rc=256} 13:39:28.963965 --- ParallelTerminationStrategy: PID 14730 died... 13:39:28.983379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14730): Terminated: ok {rc=0} 13:39:29.029531 --- ParallelTerminationStrategy: PID 14731 died... 13:39:29.049266 run iperf3-srv_10.42.42.10(pid=14731): Terminated {rc=256} 13:39:29.095352 --- ParallelTerminationStrategy: PID 14732 died... 13:39:29.114715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14732): Terminated: ok {rc=0} 13:39:29.160787 --- ParallelTerminationStrategy: PID 14733 died... 13:39:29.180433 run iperf3-srv_10.42.42.10(pid=14733): Terminated {rc=256} 13:39:29.226678 --- ParallelTerminationStrategy: PID 14734 died... 13:39:29.246246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14734): Terminated: ok {rc=0} 13:39:29.293135 --- ParallelTerminationStrategy: PID 14735 died... 13:39:29.312519 run iperf3-srv_10.42.42.10(pid=14735): Terminated {rc=256} 13:39:29.359214 --- ParallelTerminationStrategy: PID 14738 died... 13:39:29.378598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14738): Terminated: ok {rc=0} 13:39:29.424800 --- ParallelTerminationStrategy: PID 14741 died... 13:39:29.444736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14741): Terminated: ok {rc=0} 13:39:29.490978 --- ParallelTerminationStrategy: PID 14744 died... 13:39:29.510476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14744): Terminated: ok {rc=0} 13:39:29.598133 bus /gobi_4: Setting Powered False 13:39:30.695877 bus /gobi_4: Setting Powered False 13:39:31.818201 bus /gobi_1: Setting Powered False 13:39:32.913463 bus /gobi_1: Setting Powered False 13:39:34.027546 bus /gobi_0: Setting Powered False 13:39:35.126215 bus /gobi_0: Setting Powered False 13:39:36.241845 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 13:39:37.343985 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:37.355521 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:39:37.401444 tst ping.py: using LAC 28775 13:39:37.517126 tst ping.py: using RAC 215 13:39:37.630691 tst ping.py: using CellId 28775 13:39:37.744397 tst ping.py: using BVCI 28776 13:39:37.849278 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:37.860094 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:37.870715 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:37.881477 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:37.891967 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:37.902582 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:37.913326 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:37.923836 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:39:38.040299 tst ping.py:19: start network... 13:39:38.249593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:38.728348 run create_hlr_db(pid=14746): Launched 13:39:38.846171 bus /gobi_6: Setting Powered False 13:39:39.907862 run create_hlr_db(pid=14746): Terminated: ok {rc=0} 13:39:40.322306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14748): Launched 13:39:40.610922 run osmo-hlr_10.42.42.2(pid=14749): Launched 13:39:40.721543 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:41.222590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14751): Launched 13:39:41.510324 run osmo-stp_10.42.42.5(pid=14752): Launched 13:39:41.619269 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:39:42.119421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14754): Launched 13:39:42.230161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:39:42.475742 run patchelf(pid=14755): Launched 13:39:42.637100 run osmo-stp_10.42.42.5(pid=14752): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14752)] 13:39:42.759982 run osmo-stp_10.42.42.5(pid=14752): stdout: | (launched: 2022-12-10_13:39:41.457651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:42.884323 run osmo-stp_10.42.42.5(pid=14752): stderr: | [0;m[38;5;43m20221210133941625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133941625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133941625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133941626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133941626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133941626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133941626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:43.008906 run osmo-stp_10.42.42.5(pid=14752): stdout: | (launched: 2022-12-10_13:39:41.457651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:43.128766 run osmo-stp_10.42.42.5(pid=14752): stderr: | [0;m[38;5;43m20221210133941625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133941625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133941625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133941626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133941626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133941626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133941626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:43.270266 run patchelf(pid=14755): Terminating (SIGINT) 13:39:43.434316 run patchelf(pid=14755): Terminated: ok {rc=0} 13:39:43.552405 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14752): Process ended prematurely: osmo-stp_10.42.42.5(pid=14752) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14752)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 13:39:43.561139 tst ping.py:22: Test FAILED (6.2 sec) 13:39:43.587539 run osmo-hlr_10.42.42.2(pid=14749): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14749)] 13:39:43.634381 run osmo-hlr_10.42.42.2(pid=14749): stdout: | (launched: 2022-12-10_13:39:40.557847) 13:39:43.682947 run osmo-hlr_10.42.42.2(pid=14749): stderr: | [0;m[1;31m20221210133940733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133940733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133940733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133940733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133940733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133940733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133940749 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133940757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133940757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133940757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:43.732112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14748): Terminating (SIGTERM) 13:39:43.771495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14751): Terminating (SIGTERM) 13:39:43.810882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14754): Terminating (SIGTERM) 13:39:43.850522 --- ParallelTerminationStrategy: PID 14748 died... 13:39:43.869359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14748): Terminated: ok {rc=0} 13:39:43.913098 --- ParallelTerminationStrategy: PID 14751 died... 13:39:43.931552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14751): Terminated: ok {rc=0} 13:39:43.974957 --- ParallelTerminationStrategy: PID 14754 died... 13:39:43.993501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14754): Terminated: ok {rc=0} 13:39:44.078689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:39:45.166249 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:45.178253 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:39:45.225415 tst ping_idle_ping.py: using LAC 28776 13:39:45.341416 tst ping_idle_ping.py: using RAC 216 13:39:45.465036 tst ping_idle_ping.py: using CellId 28776 13:39:45.587390 tst ping_idle_ping.py: using BVCI 28777 13:39:45.701387 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:45.712824 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:45.724183 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:45.736198 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:45.748489 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:45.761360 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:45.773624 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:39:45.784781 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:39:45.915478 tst ping_idle_ping.py:24: start network... 13:39:46.153073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:46.692016 run create_hlr_db(pid=14756): Launched 13:39:46.874651 bus /gobi_6: Setting Powered False 13:39:47.934262 run create_hlr_db(pid=14756): Terminated: ok {rc=0} 13:39:48.415110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14758): Launched 13:39:48.725330 run osmo-hlr_10.42.42.2(pid=14759): Launched 13:39:48.843885 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:49.382810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14761): Launched 13:39:49.698260 run osmo-stp_10.42.42.5(pid=14762): Launched 13:39:49.816237 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:39:50.353276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14764): Launched 13:39:50.471593 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:39:50.734265 run patchelf(pid=14765): Launched 13:39:50.907208 run osmo-stp_10.42.42.5(pid=14762): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14762)] 13:39:51.039856 run osmo-stp_10.42.42.5(pid=14762): stdout: | (launched: 2022-12-10_13:39:49.642010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:51.173315 run osmo-stp_10.42.42.5(pid=14762): stderr: | [0;m[38;5;43m20221210133949830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133949830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133949830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133949831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133949833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133949833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133949833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:51.307233 run osmo-stp_10.42.42.5(pid=14762): stdout: | (launched: 2022-12-10_13:39:49.642010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:51.435372 run osmo-stp_10.42.42.5(pid=14762): stderr: | [0;m[38;5;43m20221210133949830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210133949830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210133949830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210133949831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210133949833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210133949833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210133949833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:51.587070 run patchelf(pid=14765): Terminating (SIGINT) 13:39:51.762058 run patchelf(pid=14765): Terminated: ok {rc=0} 13:39:51.888579 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14762): Process ended prematurely: osmo-stp_10.42.42.5(pid=14762) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14762)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 13:39:51.898102 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:39:51.926357 run osmo-hlr_10.42.42.2(pid=14759): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14759)] 13:39:51.977064 run osmo-hlr_10.42.42.2(pid=14759): stdout: | (launched: 2022-12-10_13:39:48.669073) 13:39:52.028770 run osmo-hlr_10.42.42.2(pid=14759): stderr: | [0;m[1;31m20221210133948867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133948867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133948867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133948867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133948867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133948867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133948879 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133948890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133948890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133948890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:52.081062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14758): Terminating (SIGTERM) 13:39:52.122937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14761): Terminating (SIGTERM) 13:39:52.164908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14764): Terminating (SIGTERM) 13:39:52.207335 --- ParallelTerminationStrategy: PID 14758 died... 13:39:52.227014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14758): Terminated: ok {rc=0} 13:39:52.273492 --- ParallelTerminationStrategy: PID 14761 died... 13:39:52.292712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14761): Terminated: ok {rc=0} 13:39:52.339744 --- ParallelTerminationStrategy: PID 14764 died... 13:39:52.359169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14764): Terminated: ok {rc=0} 13:39:52.446702 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:39:53.745384 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:39:53.751697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:39:53.782108 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:39:53.820860 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:39:53.911638 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:39:53.941733 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:39:53.980640 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:39:54.572697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:39:54.624087 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:39:54.635395 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:39:54.700197 tst cs_paging_gprs_active.py: using LAC 28777 13:39:54.817408 tst cs_paging_gprs_active.py: using RAC 217 13:39:54.932662 tst cs_paging_gprs_active.py: using CellId 28777 13:39:55.048667 tst cs_paging_gprs_active.py: using BVCI 28778 13:39:55.156482 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:39:55.167521 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:39:55.178367 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:39:55.189185 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:39:55.199748 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:39:55.210773 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:39:55.221510 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:39:55.232183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:39:55.242997 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:39:55.362722 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:39:55.479546 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:39:55.678977 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:39:55.976497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14771): Launched 13:39:56.234112 run iperf3-srv_10.42.42.10(pid=14772): Launched 13:39:56.344797 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:39:56.542235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:39:56.838823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14773): Launched 13:39:57.097162 run iperf3-srv_10.42.42.10(pid=14774): Launched 13:39:57.207638 tst cs_paging_gprs_active.py:38: start network... 13:39:57.405907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:57.864445 run create_hlr_db(pid=14775): Launched 13:39:57.985982 bus /gobi_6: Setting Powered False 13:39:59.044930 run create_hlr_db(pid=14775): Terminated: ok {rc=0} 13:39:59.475602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14777): Launched 13:39:59.792101 run osmo-hlr_10.42.42.2(pid=14778): Launched 13:39:59.913069 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:00.461882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14780): Launched 13:40:00.777564 run osmo-stp_10.42.42.5(pid=14781): Launched 13:40:00.910359 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:40:01.609944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14783): Launched 13:40:01.761658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:40:02.038825 run patchelf(pid=14787): Launched 13:40:02.215972 run osmo-stp_10.42.42.5(pid=14781): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14781)] 13:40:02.345810 run osmo-stp_10.42.42.5(pid=14781): stdout: | (launched: 2022-12-10_13:40:00.720317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:02.474109 run osmo-stp_10.42.42.5(pid=14781): stderr: | [0;m[38;5;43m20221210134001013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134001013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134001013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134001014 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134001016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134001016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134001016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:02.601584 run osmo-stp_10.42.42.5(pid=14781): stdout: | (launched: 2022-12-10_13:40:00.720317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:02.723328 run osmo-stp_10.42.42.5(pid=14781): stderr: | [0;m[38;5;43m20221210134001013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134001013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134001013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134001014 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134001016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134001016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134001016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:02.867385 run patchelf(pid=14787): Terminating (SIGINT) 13:40:03.034512 run patchelf(pid=14787): Terminated: ok {rc=0} 13:40:03.155105 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14781): Process ended prematurely: osmo-stp_10.42.42.5(pid=14781) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14781)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:40:03.164216 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:40:03.190949 run osmo-hlr_10.42.42.2(pid=14778): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14778)] 13:40:03.238133 run osmo-hlr_10.42.42.2(pid=14778): stdout: | (launched: 2022-12-10_13:39:59.734832) 13:40:03.287003 run osmo-hlr_10.42.42.2(pid=14778): stderr: | [0;m[1;31m20221210133959934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210133959934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210133959934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210133959934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210133959934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210133959935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210133959946 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210133959955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210133959955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210133959955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:03.336171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14771): Terminating (SIGTERM) 13:40:03.374972 run iperf3-srv_10.42.42.10(pid=14772): Terminating (SIGTERM) 13:40:03.413628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14773): Terminating (SIGTERM) 13:40:03.452369 run iperf3-srv_10.42.42.10(pid=14774): Terminating (SIGTERM) 13:40:03.491017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14777): Terminating (SIGTERM) 13:40:03.529990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14780): Terminating (SIGTERM) 13:40:03.568800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14783): Terminating (SIGTERM) 13:40:03.607743 --- ParallelTerminationStrategy: PID 14771 died... 13:40:03.626318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14771): Terminated: ok {rc=0} 13:40:03.669779 --- ParallelTerminationStrategy: PID 14772 died... 13:40:03.687872 run iperf3-srv_10.42.42.10(pid=14772): Terminated {rc=256} 13:40:03.730738 --- ParallelTerminationStrategy: PID 14773 died... 13:40:03.748941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14773): Terminated: ok {rc=0} 13:40:03.791313 --- ParallelTerminationStrategy: PID 14774 died... 13:40:03.809434 run iperf3-srv_10.42.42.10(pid=14774): Terminated {rc=256} 13:40:03.852121 --- ParallelTerminationStrategy: PID 14777 died... 13:40:03.870371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14777): Terminated: ok {rc=0} 13:40:03.912764 --- ParallelTerminationStrategy: PID 14780 died... 13:40:03.930968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14780): Terminated: ok {rc=0} 13:40:03.973702 --- ParallelTerminationStrategy: PID 14783 died... 13:40:03.991890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14783): Terminated: ok {rc=0} 13:40:04.075618 bus /gobi_0: Setting Powered False 13:40:05.174628 bus /gobi_0: Setting Powered False 13:40:06.288489 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:40:07.431809 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:07.443430 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:40:07.509734 tst iperf3.py: using LAC 28778 13:40:07.628141 tst iperf3.py: using RAC 218 13:40:07.753778 tst iperf3.py: using CellId 28778 13:40:07.878788 tst iperf3.py: using BVCI 28779 13:40:07.997077 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:08.008322 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:08.019699 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:08.031313 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:08.042733 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:08.054048 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:08.065753 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:08.077076 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:08.088482 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:40:08.204611 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:40:08.402739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:40:08.698755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14788): Launched 13:40:08.956494 run iperf3-srv_10.42.42.10(pid=14789): Launched 13:40:09.067278 tst iperf3.py:8: start network... 13:40:09.264795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:09.723900 run create_hlr_db(pid=14790): Launched 13:40:09.844895 bus /gobi_6: Setting Powered False 13:40:10.903513 run create_hlr_db(pid=14790): Terminated: ok {rc=0} 13:40:11.314424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14792): Launched 13:40:11.609595 run osmo-hlr_10.42.42.2(pid=14793): Launched 13:40:11.722412 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:12.237353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14795): Launched 13:40:12.531205 run osmo-stp_10.42.42.5(pid=14796): Launched 13:40:12.643566 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:40:13.153893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14798): Launched 13:40:13.266187 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:40:13.516331 run patchelf(pid=14799): Launched 13:40:13.680792 run osmo-stp_10.42.42.5(pid=14796): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14796)] 13:40:13.806194 run osmo-stp_10.42.42.5(pid=14796): stdout: | (launched: 2022-12-10_13:40:12.477580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:13.933436 run osmo-stp_10.42.42.5(pid=14796): stderr: | [0;m[38;5;43m20221210134012644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134012645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134012645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134012645 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134012648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134012648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134012648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:14.060613 run osmo-stp_10.42.42.5(pid=14796): stdout: | (launched: 2022-12-10_13:40:12.477580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:14.182511 run osmo-stp_10.42.42.5(pid=14796): stderr: | [0;m[38;5;43m20221210134012644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134012645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134012645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134012645 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134012648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134012648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134012648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:14.326648 run patchelf(pid=14799): Terminating (SIGINT) 13:40:14.493857 run patchelf(pid=14799): Terminated: ok {rc=0} 13:40:14.613721 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14796): Process ended prematurely: osmo-stp_10.42.42.5(pid=14796) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14796)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 13:40:14.622973 tst iperf3.py:8: Test FAILED (7.2 sec) 13:40:14.649836 run osmo-hlr_10.42.42.2(pid=14793): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14793)] 13:40:14.697163 run osmo-hlr_10.42.42.2(pid=14793): stdout: | (launched: 2022-12-10_13:40:11.555193) 13:40:14.745796 run osmo-hlr_10.42.42.2(pid=14793): stderr: | [0;m[1;31m20221210134011732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134011732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134011732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134011732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134011732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134011732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134011745 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134011753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134011753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134011753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:14.795647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14788): Terminating (SIGTERM) 13:40:14.834975 run iperf3-srv_10.42.42.10(pid=14789): Terminating (SIGTERM) 13:40:14.874160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14792): Terminating (SIGTERM) 13:40:14.913444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14795): Terminating (SIGTERM) 13:40:14.952629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14798): Terminating (SIGTERM) 13:40:14.992001 --- ParallelTerminationStrategy: PID 14788 died... 13:40:15.010363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14788): Terminated: ok {rc=0} 13:40:15.053683 --- ParallelTerminationStrategy: PID 14789 died... 13:40:15.071816 run iperf3-srv_10.42.42.10(pid=14789): Terminated {rc=256} 13:40:15.114978 --- ParallelTerminationStrategy: PID 14792 died... 13:40:15.133334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14792): Terminated: ok {rc=0} 13:40:15.176344 --- ParallelTerminationStrategy: PID 14795 died... 13:40:15.194470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14795): Terminated: ok {rc=0} 13:40:15.237416 --- ParallelTerminationStrategy: PID 14798 died... 13:40:15.255517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14798): Terminated: ok {rc=0} 13:40:15.339547 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:40:16.509599 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:16.525550 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:40:16.591460 tst iperf3m4.py: using LAC 28779 13:40:16.721488 tst iperf3m4.py: using RAC 219 13:40:16.845904 tst iperf3m4.py: using CellId 28779 13:40:17.000330 tst iperf3m4.py: using BVCI 28780 13:40:17.159494 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:17.174548 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:17.188197 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:17.201440 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:17.213617 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:17.226645 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:17.241109 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:17.254268 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:17.266532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:40:17.388103 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:40:17.506694 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:40:17.624177 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:40:17.741598 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:40:17.939055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:40:18.233930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14800): Launched 13:40:18.490968 run iperf3-srv_10.42.42.10(pid=14801): Launched 13:40:18.610196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:40:18.823168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:40:19.140443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14802): Launched 13:40:19.414639 run iperf3-srv_10.42.42.10(pid=14803): Launched 13:40:19.533186 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:40:19.745748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:40:20.063119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14804): Launched 13:40:20.338339 run iperf3-srv_10.42.42.10(pid=14805): Launched 13:40:20.456849 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:40:20.669327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:40:20.986413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14806): Launched 13:40:21.261194 run iperf3-srv_10.42.42.10(pid=14807): Launched 13:40:21.379686 tst iperf3m4.py:8: start network... 13:40:21.592474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:22.080859 run create_hlr_db(pid=14808): Launched 13:40:22.201197 bus /gobi_6: Setting Powered False 13:40:23.263526 run create_hlr_db(pid=14808): Terminated: ok {rc=0} 13:40:23.685261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14810): Launched 13:40:23.980182 run osmo-hlr_10.42.42.2(pid=14811): Launched 13:40:24.092617 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:24.613434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14813): Launched 13:40:24.909131 run osmo-stp_10.42.42.5(pid=14814): Launched 13:40:25.024997 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:40:25.535433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14816): Launched 13:40:25.647599 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:40:25.897351 run patchelf(pid=14817): Launched 13:40:26.061387 run osmo-stp_10.42.42.5(pid=14814): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14814)] 13:40:26.186055 run osmo-stp_10.42.42.5(pid=14814): stdout: | (launched: 2022-12-10_13:40:24.854833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:26.312573 run osmo-stp_10.42.42.5(pid=14814): stderr: | [0;m[38;5;43m20221210134025027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134025027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134025027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134025028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134025028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134025028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134025028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:26.439189 run osmo-stp_10.42.42.5(pid=14814): stdout: | (launched: 2022-12-10_13:40:24.854833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:26.560454 run osmo-stp_10.42.42.5(pid=14814): stderr: | [0;m[38;5;43m20221210134025027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134025027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134025027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134025028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134025028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134025028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134025028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:26.704359 run patchelf(pid=14817): Terminating (SIGINT) 13:40:26.870969 run patchelf(pid=14817): Terminated: ok {rc=0} 13:40:26.990797 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14814): Process ended prematurely: osmo-stp_10.42.42.5(pid=14814) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14814)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:40:27.000068 tst iperf3m4.py:8: Test FAILED (10.5 sec) 13:40:27.026690 run osmo-hlr_10.42.42.2(pid=14811): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14811)] 13:40:27.073233 run osmo-hlr_10.42.42.2(pid=14811): stdout: | (launched: 2022-12-10_13:40:23.926151) 13:40:27.121419 run osmo-hlr_10.42.42.2(pid=14811): stderr: | [0;m[1;31m20221210134024101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134024101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134024101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134024101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134024101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134024101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134024113 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134024122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134024122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134024122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:27.169825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14800): Terminating (SIGTERM) 13:40:27.208497 run iperf3-srv_10.42.42.10(pid=14801): Terminating (SIGTERM) 13:40:27.247360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14802): Terminating (SIGTERM) 13:40:27.286067 run iperf3-srv_10.42.42.10(pid=14803): Terminating (SIGTERM) 13:40:27.324537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14804): Terminating (SIGTERM) 13:40:27.363230 run iperf3-srv_10.42.42.10(pid=14805): Terminating (SIGTERM) 13:40:27.401831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14806): Terminating (SIGTERM) 13:40:27.440354 run iperf3-srv_10.42.42.10(pid=14807): Terminating (SIGTERM) 13:40:27.479118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14810): Terminating (SIGTERM) 13:40:27.517863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14813): Terminating (SIGTERM) 13:40:27.556215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14816): Terminating (SIGTERM) 13:40:27.594832 --- ParallelTerminationStrategy: PID 14800 died... 13:40:27.613558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14800): Terminated: ok {rc=0} 13:40:27.657095 --- ParallelTerminationStrategy: PID 14801 died... 13:40:27.675306 run iperf3-srv_10.42.42.10(pid=14801): Terminated {rc=256} 13:40:27.718034 --- ParallelTerminationStrategy: PID 14802 died... 13:40:27.736163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14802): Terminated: ok {rc=0} 13:40:27.778941 --- ParallelTerminationStrategy: PID 14803 died... 13:40:27.796898 run iperf3-srv_10.42.42.10(pid=14803): Terminated {rc=256} 13:40:27.839571 --- ParallelTerminationStrategy: PID 14804 died... 13:40:27.857690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14804): Terminated: ok {rc=0} 13:40:27.900543 --- ParallelTerminationStrategy: PID 14805 died... 13:40:27.918692 run iperf3-srv_10.42.42.10(pid=14805): Terminated {rc=256} 13:40:27.962027 --- ParallelTerminationStrategy: PID 14806 died... 13:40:27.980081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14806): Terminated: ok {rc=0} 13:40:28.023199 --- ParallelTerminationStrategy: PID 14807 died... 13:40:28.041319 run iperf3-srv_10.42.42.10(pid=14807): Terminated {rc=256} 13:40:28.084044 --- ParallelTerminationStrategy: PID 14810 died... 13:40:28.102255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14810): Terminated: ok {rc=0} 13:40:28.145183 --- ParallelTerminationStrategy: PID 14813 died... 13:40:28.163271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14813): Terminated: ok {rc=0} 13:40:28.206092 --- ParallelTerminationStrategy: PID 14816 died... 13:40:28.224178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14816): Terminated: ok {rc=0} 13:40:28.307174 bus /gobi_4: Setting Powered False 13:40:29.406393 bus /gobi_4: Setting Powered False 13:40:30.519798 bus /gobi_1: Setting Powered False 13:40:31.616613 bus /gobi_1: Setting Powered False 13:40:32.734468 bus /gobi_0: Setting Powered False 13:40:33.832474 bus /gobi_0: Setting Powered False 13:40:34.944258 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:40:36.045824 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:36.057953 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:40:36.123548 tst ping.py: using LAC 28780 13:40:36.244816 tst ping.py: using RAC 220 13:40:36.364898 tst ping.py: using CellId 28780 13:40:36.485149 tst ping.py: using BVCI 28781 13:40:36.597927 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:36.609386 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:36.620443 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:36.631818 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:36.643068 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:36.654566 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:36.666389 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:36.677733 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:40:36.792663 tst ping.py:19: start network... 13:40:37.001224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:37.480055 run create_hlr_db(pid=14818): Launched 13:40:37.604508 bus /gobi_6: Setting Powered False 13:40:38.663570 run create_hlr_db(pid=14818): Terminated: ok {rc=0} 13:40:39.087606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14820): Launched 13:40:39.397850 run osmo-hlr_10.42.42.2(pid=14821): Launched 13:40:39.516249 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:40.056706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14823): Launched 13:40:40.368419 run osmo-stp_10.42.42.5(pid=14824): Launched 13:40:40.487142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:40:41.023569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14826): Launched 13:40:41.141665 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:40:41.403422 run patchelf(pid=14827): Launched 13:40:41.576119 run osmo-stp_10.42.42.5(pid=14824): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14824)] 13:40:41.707645 run osmo-stp_10.42.42.5(pid=14824): stdout: | (launched: 2022-12-10_13:40:40.310616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:41.840582 run osmo-stp_10.42.42.5(pid=14824): stderr: | [0;m[38;5;43m20221210134040501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134040501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134040502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134040502 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134040504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134040504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134040505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:41.994069 run osmo-stp_10.42.42.5(pid=14824): stdout: | (launched: 2022-12-10_13:40:40.310616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:42.113488 run osmo-stp_10.42.42.5(pid=14824): stderr: | [0;m[38;5;43m20221210134040501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134040501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134040502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134040502 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134040504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134040504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134040505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:42.254793 run patchelf(pid=14827): Terminating (SIGINT) 13:40:42.418730 run patchelf(pid=14827): Terminated: ok {rc=0} 13:40:42.536402 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14824): Process ended prematurely: osmo-stp_10.42.42.5(pid=14824) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14824)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 13:40:42.545495 tst ping.py:22: Test FAILED (6.5 sec) 13:40:42.571859 run osmo-hlr_10.42.42.2(pid=14821): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14821)] 13:40:42.619055 run osmo-hlr_10.42.42.2(pid=14821): stdout: | (launched: 2022-12-10_13:40:39.341534) 13:40:42.667824 run osmo-hlr_10.42.42.2(pid=14821): stderr: | [0;m[1;31m20221210134039537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134039537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134039537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134039537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134039537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134039537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134039554 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134039562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134039563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134039563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:42.716924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14820): Terminating (SIGTERM) 13:40:42.756715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14823): Terminating (SIGTERM) 13:40:42.796290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14826): Terminating (SIGTERM) 13:40:42.835775 --- ParallelTerminationStrategy: PID 14820 died... 13:40:42.854752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14820): Terminated: ok {rc=0} 13:40:42.898257 --- ParallelTerminationStrategy: PID 14823 died... 13:40:42.916517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14823): Terminated: ok {rc=0} 13:40:42.960469 --- ParallelTerminationStrategy: PID 14826 died... 13:40:42.978909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14826): Terminated: ok {rc=0} 13:40:43.063647 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:40:44.152199 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:44.164049 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:40:44.229616 tst ping_idle_ping.py: using LAC 28781 13:40:44.344584 tst ping_idle_ping.py: using RAC 221 13:40:44.459035 tst ping_idle_ping.py: using CellId 28781 13:40:44.573473 tst ping_idle_ping.py: using BVCI 28782 13:40:44.678867 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:44.689807 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:44.700531 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:44.711331 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:44.721985 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:44.732623 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:44.743393 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:40:44.754069 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:40:44.870843 tst ping_idle_ping.py:24: start network... 13:40:45.081043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:45.564467 run create_hlr_db(pid=14828): Launched 13:40:45.683712 bus /gobi_6: Setting Powered False 13:40:46.755266 run create_hlr_db(pid=14828): Terminated: ok {rc=0} 13:40:47.257819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14830): Launched 13:40:47.557463 run osmo-hlr_10.42.42.2(pid=14831): Launched 13:40:47.670976 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:48.177637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14833): Launched 13:40:48.469756 run osmo-stp_10.42.42.5(pid=14834): Launched 13:40:48.581559 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:40:49.087379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14836): Launched 13:40:49.198515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:40:49.444417 run patchelf(pid=14837): Launched 13:40:49.606337 run osmo-stp_10.42.42.5(pid=14834): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14834)] 13:40:49.730786 run osmo-stp_10.42.42.5(pid=14834): stdout: | (launched: 2022-12-10_13:40:48.416060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:49.855793 run osmo-stp_10.42.42.5(pid=14834): stderr: | [0;m[38;5;43m20221210134048587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134048587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134048588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134048588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134048588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134048589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134048589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:49.980942 run osmo-stp_10.42.42.5(pid=14834): stdout: | (launched: 2022-12-10_13:40:48.416060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:50.101293 run osmo-stp_10.42.42.5(pid=14834): stderr: | [0;m[38;5;43m20221210134048587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134048587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134048588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134048588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134048588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134048589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134048589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:50.243258 run patchelf(pid=14837): Terminating (SIGINT) 13:40:50.408687 run patchelf(pid=14837): Terminated: ok {rc=0} 13:40:50.527294 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14834): Process ended prematurely: osmo-stp_10.42.42.5(pid=14834) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14834)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:40:50.535743 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:40:50.561971 run osmo-hlr_10.42.42.2(pid=14831): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14831)] 13:40:50.609164 run osmo-hlr_10.42.42.2(pid=14831): stdout: | (launched: 2022-12-10_13:40:47.503880) 13:40:50.657590 run osmo-hlr_10.42.42.2(pid=14831): stderr: | [0;m[1;31m20221210134047680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134047681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134047681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134047681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134047681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134047681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134047693 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134047702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134047702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134047702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:50.706541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14830): Terminating (SIGTERM) 13:40:50.745550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14833): Terminating (SIGTERM) 13:40:50.784580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14836): Terminating (SIGTERM) 13:40:50.823828 --- ParallelTerminationStrategy: PID 14830 died... 13:40:50.842639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14830): Terminated: ok {rc=0} 13:40:50.885830 --- ParallelTerminationStrategy: PID 14833 died... 13:40:50.903894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14833): Terminated: ok {rc=0} 13:40:50.947231 --- ParallelTerminationStrategy: PID 14836 died... 13:40:50.965601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14836): Terminated: ok {rc=0} 13:40:51.048033 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:40:52.348739 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:40:52.355320 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:40:52.385501 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:40:52.424310 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:40:52.511366 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:40:52.541059 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:40:52.580098 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:40:53.177094 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:40:53.228258 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:40:53.239583 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:40:53.305940 tst cs_paging_gprs_active.py: using LAC 28782 13:40:53.431411 tst cs_paging_gprs_active.py: using RAC 222 13:40:53.558007 tst cs_paging_gprs_active.py: using CellId 28782 13:40:53.682095 tst cs_paging_gprs_active.py: using BVCI 28783 13:40:53.798218 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:40:53.809563 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:40:53.820638 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:40:53.832134 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:40:53.843545 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:40:53.854840 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:40:53.866420 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:40:53.877763 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:40:53.889198 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:40:54.010405 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:40:54.126177 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:40:54.326218 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:40:54.625357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14841): Launched 13:40:54.885973 run iperf3-srv_10.42.42.10(pid=14842): Launched 13:40:54.997669 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:40:55.196099 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:40:55.496290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14843): Launched 13:40:55.756867 run iperf3-srv_10.42.42.10(pid=14844): Launched 13:40:55.868209 tst cs_paging_gprs_active.py:38: start network... 13:40:56.067006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:56.528006 run create_hlr_db(pid=14845): Launched 13:40:56.650398 bus /gobi_6: Setting Powered False 13:40:57.714328 run create_hlr_db(pid=14845): Terminated: ok {rc=0} 13:40:58.138489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14847): Launched 13:40:58.435092 run osmo-hlr_10.42.42.2(pid=14848): Launched 13:40:58.548139 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:59.058778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14850): Launched 13:40:59.355731 run osmo-stp_10.42.42.5(pid=14851): Launched 13:40:59.469412 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:40:59.981481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14853): Launched 13:41:00.094706 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:00.351507 run patchelf(pid=14854): Launched 13:41:00.516440 run osmo-stp_10.42.42.5(pid=14851): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14851)] 13:41:00.643042 run osmo-stp_10.42.42.5(pid=14851): stdout: | (launched: 2022-12-10_13:40:59.301225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:00.770517 run osmo-stp_10.42.42.5(pid=14851): stderr: | [0;m[38;5;43m20221210134059471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134059471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134059472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134059472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134059473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134059473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134059473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:00.906609 run osmo-stp_10.42.42.5(pid=14851): stdout: | (launched: 2022-12-10_13:40:59.301225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:01.030807 run osmo-stp_10.42.42.5(pid=14851): stderr: | [0;m[38;5;43m20221210134059471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134059471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134059472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134059472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134059473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134059473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134059473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:01.178249 run patchelf(pid=14854): Terminating (SIGINT) 13:41:01.348620 run patchelf(pid=14854): Terminated: ok {rc=0} 13:41:01.471588 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14851): Process ended prematurely: osmo-stp_10.42.42.5(pid=14851) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14851)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:41:01.481580 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 13:41:01.511099 run osmo-hlr_10.42.42.2(pid=14848): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14848)] 13:41:01.559688 run osmo-hlr_10.42.42.2(pid=14848): stdout: | (launched: 2022-12-10_13:40:58.380535) 13:41:01.609613 run osmo-hlr_10.42.42.2(pid=14848): stderr: | [0;m[1;31m20221210134058555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134058555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134058555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134058555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134058555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134058555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134058568 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134058577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134058577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134058577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:01.660454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14841): Terminating (SIGTERM) 13:41:01.701047 run iperf3-srv_10.42.42.10(pid=14842): Terminating (SIGTERM) 13:41:01.741874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14843): Terminating (SIGTERM) 13:41:01.783333 run iperf3-srv_10.42.42.10(pid=14844): Terminating (SIGTERM) 13:41:01.826681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14847): Terminating (SIGTERM) 13:41:01.867890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14850): Terminating (SIGTERM) 13:41:01.913345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14853): Terminating (SIGTERM) 13:41:01.960177 --- ParallelTerminationStrategy: PID 14841 died... 13:41:01.981609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14841): Terminated: ok {rc=0} 13:41:02.033549 --- ParallelTerminationStrategy: PID 14842 died... 13:41:02.054025 run iperf3-srv_10.42.42.10(pid=14842): Terminated {rc=256} 13:41:02.104772 --- ParallelTerminationStrategy: PID 14843 died... 13:41:02.125497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14843): Terminated: ok {rc=0} 13:41:02.174849 --- ParallelTerminationStrategy: PID 14844 died... 13:41:02.195177 run iperf3-srv_10.42.42.10(pid=14844): Terminated {rc=256} 13:41:02.244666 --- ParallelTerminationStrategy: PID 14847 died... 13:41:02.265473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14847): Terminated: ok {rc=0} 13:41:02.313164 --- ParallelTerminationStrategy: PID 14850 died... 13:41:02.333112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14850): Terminated: ok {rc=0} 13:41:02.380659 --- ParallelTerminationStrategy: PID 14853 died... 13:41:02.400170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14853): Terminated: ok {rc=0} 13:41:02.489318 bus /gobi_0: Setting Powered False 13:41:03.587162 bus /gobi_0: Setting Powered False 13:41:04.705572 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:41:05.848013 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:05.859540 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:41:05.925143 tst iperf3.py: using LAC 28783 13:41:06.043652 tst iperf3.py: using RAC 223 13:41:06.162671 tst iperf3.py: using CellId 28783 13:41:06.281187 tst iperf3.py: using BVCI 28784 13:41:06.389433 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:06.400289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:06.411038 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:06.421752 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:06.432316 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:06.442959 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:06.454172 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:06.464673 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:06.475437 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:41:06.591755 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:41:06.804638 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:07.121364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14855): Launched 13:41:07.394426 run iperf3-srv_10.42.42.10(pid=14856): Launched 13:41:07.512680 tst iperf3.py:8: start network... 13:41:07.725652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:08.216077 run create_hlr_db(pid=14857): Launched 13:41:08.336173 bus /gobi_6: Setting Powered False 13:41:09.397855 run create_hlr_db(pid=14857): Terminated: ok {rc=0} 13:41:09.819345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14859): Launched 13:41:10.115057 run osmo-hlr_10.42.42.2(pid=14860): Launched 13:41:10.227998 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:10.741039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14862): Launched 13:41:11.036899 run osmo-stp_10.42.42.5(pid=14863): Launched 13:41:11.150693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:41:11.662284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14865): Launched 13:41:11.774857 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:12.025666 run patchelf(pid=14866): Launched 13:41:12.190749 run osmo-stp_10.42.42.5(pid=14863): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14863)] 13:41:12.316293 run osmo-stp_10.42.42.5(pid=14863): stdout: | (launched: 2022-12-10_13:41:10.982756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:12.443429 run osmo-stp_10.42.42.5(pid=14863): stderr: | [0;m[38;5;43m20221210134111156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134111156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134111156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134111156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134111157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134111157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134111157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:12.570765 run osmo-stp_10.42.42.5(pid=14863): stdout: | (launched: 2022-12-10_13:41:10.982756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:12.692639 run osmo-stp_10.42.42.5(pid=14863): stderr: | [0;m[38;5;43m20221210134111156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134111156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134111156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134111156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134111157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134111157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134111157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:12.837342 run patchelf(pid=14866): Terminating (SIGINT) 13:41:13.003944 run patchelf(pid=14866): Terminated: ok {rc=0} 13:41:13.124097 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14863): Process ended prematurely: osmo-stp_10.42.42.5(pid=14863) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14863)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 13:41:13.133729 tst iperf3.py:8: Test FAILED (7.3 sec) 13:41:13.160271 run osmo-hlr_10.42.42.2(pid=14860): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14860)] 13:41:13.206984 run osmo-hlr_10.42.42.2(pid=14860): stdout: | (launched: 2022-12-10_13:41:10.060941) 13:41:13.255542 run osmo-hlr_10.42.42.2(pid=14860): stderr: | [0;m[1;31m20221210134110233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134110233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134110234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134110234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134110234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134110234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134110246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134110255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134110255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134110255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:13.304334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14855): Terminating (SIGTERM) 13:41:13.343424 run iperf3-srv_10.42.42.10(pid=14856): Terminating (SIGTERM) 13:41:13.382249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14859): Terminating (SIGTERM) 13:41:13.421182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14862): Terminating (SIGTERM) 13:41:13.459949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14865): Terminating (SIGTERM) 13:41:13.499304 --- ParallelTerminationStrategy: PID 14855 died... 13:41:13.518141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14855): Terminated: ok {rc=0} 13:41:13.561531 --- ParallelTerminationStrategy: PID 14856 died... 13:41:13.579761 run iperf3-srv_10.42.42.10(pid=14856): Terminated {rc=256} 13:41:13.622672 --- ParallelTerminationStrategy: PID 14859 died... 13:41:13.640895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14859): Terminated: ok {rc=0} 13:41:13.683956 --- ParallelTerminationStrategy: PID 14862 died... 13:41:13.702393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14862): Terminated: ok {rc=0} 13:41:13.745893 --- ParallelTerminationStrategy: PID 14865 died... 13:41:13.764209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14865): Terminated: ok {rc=0} 13:41:13.849191 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:41:14.993105 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:15.004664 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:41:15.070313 tst iperf3m4.py: using LAC 28784 13:41:15.188300 tst iperf3m4.py: using RAC 224 13:41:15.305068 tst iperf3m4.py: using CellId 28784 13:41:15.421514 tst iperf3m4.py: using BVCI 28785 13:41:15.539364 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:15.550885 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:15.562368 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:15.573891 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:15.585524 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:15.596867 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:15.608626 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:15.619981 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:15.631520 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:41:15.746305 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:41:15.882838 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:41:16.006043 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:41:16.127738 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:41:16.376820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:16.707372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14867): Launched 13:41:16.991322 run iperf3-srv_10.42.42.10(pid=14868): Launched 13:41:17.114307 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:41:17.314983 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:17.612144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14869): Launched 13:41:17.869386 run iperf3-srv_10.42.42.10(pid=14870): Launched 13:41:17.980872 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:41:18.179784 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:18.477536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14871): Launched 13:41:18.735059 run iperf3-srv_10.42.42.10(pid=14872): Launched 13:41:18.845821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:41:19.042890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:19.339463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14873): Launched 13:41:19.596371 run iperf3-srv_10.42.42.10(pid=14874): Launched 13:41:19.707063 tst iperf3m4.py:8: start network... 13:41:19.905481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:20.364926 run create_hlr_db(pid=14875): Launched 13:41:20.486015 bus /gobi_6: Setting Powered False 13:41:21.545573 run create_hlr_db(pid=14875): Terminated: ok {rc=0} 13:41:21.977056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14877): Launched 13:41:22.294649 run osmo-hlr_10.42.42.2(pid=14878): Launched 13:41:22.415875 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:22.966819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14880): Launched 13:41:23.282723 run osmo-stp_10.42.42.5(pid=14881): Launched 13:41:23.404192 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:41:23.950560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14883): Launched 13:41:24.071841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:24.338749 run patchelf(pid=14884): Launched 13:41:24.514805 run osmo-stp_10.42.42.5(pid=14881): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14881)] 13:41:24.647879 run osmo-stp_10.42.42.5(pid=14881): stdout: | (launched: 2022-12-10_13:41:23.225040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:24.783189 run osmo-stp_10.42.42.5(pid=14881): stderr: | [0;m[38;5;43m20221210134123415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134123416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134123416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134123416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134123417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134123417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134123417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:24.918574 run osmo-stp_10.42.42.5(pid=14881): stdout: | (launched: 2022-12-10_13:41:23.225040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:25.048824 run osmo-stp_10.42.42.5(pid=14881): stderr: | [0;m[38;5;43m20221210134123415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134123416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134123416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134123416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134123417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134123417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134123417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:25.202340 run patchelf(pid=14884): Terminating (SIGINT) 13:41:25.379299 run patchelf(pid=14884): Terminated: ok {rc=0} 13:41:25.506796 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14881): Process ended prematurely: osmo-stp_10.42.42.5(pid=14881) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14881)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:41:25.516778 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:41:25.545777 run osmo-hlr_10.42.42.2(pid=14878): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14878)] 13:41:25.595330 run osmo-hlr_10.42.42.2(pid=14878): stdout: | (launched: 2022-12-10_13:41:22.235945) 13:41:25.646418 run osmo-hlr_10.42.42.2(pid=14878): stderr: | [0;m[1;31m20221210134122434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134122434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134122434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134122434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134122434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134122435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134122447 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134122455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134122455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134122455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:25.697909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14867): Terminating (SIGTERM) 13:41:25.739120 run iperf3-srv_10.42.42.10(pid=14868): Terminating (SIGTERM) 13:41:25.779826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14869): Terminating (SIGTERM) 13:41:25.821010 run iperf3-srv_10.42.42.10(pid=14870): Terminating (SIGTERM) 13:41:25.863239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14871): Terminating (SIGTERM) 13:41:25.904514 run iperf3-srv_10.42.42.10(pid=14872): Terminating (SIGTERM) 13:41:25.945606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14873): Terminating (SIGTERM) 13:41:25.987291 run iperf3-srv_10.42.42.10(pid=14874): Terminating (SIGTERM) 13:41:26.028315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14877): Terminating (SIGTERM) 13:41:26.069720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14880): Terminating (SIGTERM) 13:41:26.111428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14883): Terminating (SIGTERM) 13:41:26.153231 --- ParallelTerminationStrategy: PID 14867 died... 13:41:26.172749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14867): Terminated: ok {rc=0} 13:41:26.218556 --- ParallelTerminationStrategy: PID 14868 died... 13:41:26.237645 run iperf3-srv_10.42.42.10(pid=14868): Terminated {rc=256} 13:41:26.283294 --- ParallelTerminationStrategy: PID 14869 died... 13:41:26.302459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14869): Terminated: ok {rc=0} 13:41:26.348034 --- ParallelTerminationStrategy: PID 14870 died... 13:41:26.367112 run iperf3-srv_10.42.42.10(pid=14870): Terminated {rc=256} 13:41:26.413082 --- ParallelTerminationStrategy: PID 14871 died... 13:41:26.432178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14871): Terminated: ok {rc=0} 13:41:26.478266 --- ParallelTerminationStrategy: PID 14872 died... 13:41:26.497465 run iperf3-srv_10.42.42.10(pid=14872): Terminated {rc=256} 13:41:26.543437 --- ParallelTerminationStrategy: PID 14873 died... 13:41:26.562704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14873): Terminated: ok {rc=0} 13:41:26.608446 --- ParallelTerminationStrategy: PID 14874 died... 13:41:26.627558 run iperf3-srv_10.42.42.10(pid=14874): Terminated {rc=256} 13:41:26.673247 --- ParallelTerminationStrategy: PID 14877 died... 13:41:26.692285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14877): Terminated: ok {rc=0} 13:41:26.738050 --- ParallelTerminationStrategy: PID 14880 died... 13:41:26.757388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14880): Terminated: ok {rc=0} 13:41:26.803157 --- ParallelTerminationStrategy: PID 14883 died... 13:41:26.822358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14883): Terminated: ok {rc=0} 13:41:26.909458 bus /gobi_4: Setting Powered False 13:41:28.004461 bus /gobi_4: Setting Powered False 13:41:29.117341 bus /gobi_1: Setting Powered False 13:41:30.213838 bus /gobi_1: Setting Powered False 13:41:31.340413 bus /gobi_0: Setting Powered False 13:41:32.451928 bus /gobi_0: Setting Powered False 13:41:33.567958 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:41:34.670182 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:34.682055 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:41:34.749104 tst ping.py: using LAC 28785 13:41:34.871678 tst ping.py: using RAC 225 13:41:34.993394 tst ping.py: using CellId 28785 13:41:35.116853 tst ping.py: using BVCI 28786 13:41:35.230259 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:35.241630 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:35.252749 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:35.264277 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:35.275673 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:35.287013 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:35.298547 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:35.310064 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:41:35.425487 tst ping.py:19: start network... 13:41:35.634090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:36.114026 run create_hlr_db(pid=14885): Launched 13:41:36.232255 bus /gobi_6: Setting Powered False 13:41:37.294232 run create_hlr_db(pid=14885): Terminated: ok {rc=0} 13:41:37.727963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14887): Launched 13:41:38.038374 run osmo-hlr_10.42.42.2(pid=14888): Launched 13:41:38.158599 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:38.701461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14890): Launched 13:41:39.013218 run osmo-stp_10.42.42.5(pid=14891): Launched 13:41:39.132733 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:41:39.669542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14893): Launched 13:41:39.788902 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:40.052615 run patchelf(pid=14894): Launched 13:41:40.226069 run osmo-stp_10.42.42.5(pid=14891): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14891)] 13:41:40.358199 run osmo-stp_10.42.42.5(pid=14891): stdout: | (launched: 2022-12-10_13:41:38.956041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:40.491513 run osmo-stp_10.42.42.5(pid=14891): stderr: | [0;m[38;5;43m20221210134139148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134139149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134139149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134139149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134139150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134139150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134139150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:40.625270 run osmo-stp_10.42.42.5(pid=14891): stdout: | (launched: 2022-12-10_13:41:38.956041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:40.753391 run osmo-stp_10.42.42.5(pid=14891): stderr: | [0;m[38;5;43m20221210134139148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134139149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134139149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134139149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134139150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134139150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134139150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:40.904839 run patchelf(pid=14894): Terminating (SIGINT) 13:41:41.080480 run patchelf(pid=14894): Terminated: ok {rc=0} 13:41:41.206743 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14891): Process ended prematurely: osmo-stp_10.42.42.5(pid=14891) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14891)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 13:41:41.216072 tst ping.py:22: Test FAILED (6.5 sec) 13:41:41.244580 run osmo-hlr_10.42.42.2(pid=14888): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14888)] 13:41:41.294575 run osmo-hlr_10.42.42.2(pid=14888): stdout: | (launched: 2022-12-10_13:41:37.981365) 13:41:41.346179 run osmo-hlr_10.42.42.2(pid=14888): stderr: | [0;m[1;31m20221210134138177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134138177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134138177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134138177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134138177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134138177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134138189 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134138198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134138198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134138198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:41.398058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14887): Terminating (SIGTERM) 13:41:41.439493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14890): Terminating (SIGTERM) 13:41:41.481390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14893): Terminating (SIGTERM) 13:41:41.523304 --- ParallelTerminationStrategy: PID 14887 died... 13:41:41.543154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14887): Terminated: ok {rc=0} 13:41:41.589473 --- ParallelTerminationStrategy: PID 14890 died... 13:41:41.608632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14890): Terminated: ok {rc=0} 13:41:41.655076 --- ParallelTerminationStrategy: PID 14893 died... 13:41:41.674531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14893): Terminated: ok {rc=0} 13:41:41.761952 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:41:42.847411 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:42.859075 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:41:42.926850 tst ping_idle_ping.py: using LAC 28786 13:41:43.043725 tst ping_idle_ping.py: using RAC 226 13:41:43.159065 tst ping_idle_ping.py: using CellId 28786 13:41:43.274659 tst ping_idle_ping.py: using BVCI 28787 13:41:43.380717 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:43.391781 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:43.402584 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:43.413897 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:43.425052 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:43.435666 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:43.447277 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:41:43.458405 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:41:43.576511 tst ping_idle_ping.py:24: start network... 13:41:43.786743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:44.272589 run create_hlr_db(pid=14895): Launched 13:41:44.392209 bus /gobi_6: Setting Powered False 13:41:45.455146 run create_hlr_db(pid=14895): Terminated: ok {rc=0} 13:41:45.878919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14897): Launched 13:41:46.206904 run osmo-hlr_10.42.42.2(pid=14898): Launched 13:41:46.481535 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:47.133718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14900): Launched 13:41:47.433806 run osmo-stp_10.42.42.5(pid=14901): Launched 13:41:47.547432 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:41:48.051370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14903): Launched 13:41:48.163716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:48.410043 run patchelf(pid=14904): Launched 13:41:48.572547 run osmo-stp_10.42.42.5(pid=14901): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14901)] 13:41:48.696382 run osmo-stp_10.42.42.5(pid=14901): stdout: | (launched: 2022-12-10_13:41:47.380567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:48.821819 run osmo-stp_10.42.42.5(pid=14901): stderr: | [0;m[38;5;43m20221210134147547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134147547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134147547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134147548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134147548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134147548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134147548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:48.947262 run osmo-stp_10.42.42.5(pid=14901): stdout: | (launched: 2022-12-10_13:41:47.380567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:49.067669 run osmo-stp_10.42.42.5(pid=14901): stderr: | [0;m[38;5;43m20221210134147547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134147547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134147547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134147548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134147548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134147548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134147548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:49.209878 run patchelf(pid=14904): Terminating (SIGINT) 13:41:49.374271 run patchelf(pid=14904): Terminated: ok {rc=0} 13:41:49.492221 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14901): Process ended prematurely: osmo-stp_10.42.42.5(pid=14901) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14901)] [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:41:49.501036 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:41:49.527237 run osmo-hlr_10.42.42.2(pid=14898): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14898)] 13:41:49.573741 run osmo-hlr_10.42.42.2(pid=14898): stdout: | (launched: 2022-12-10_13:41:46.145030) 13:41:49.622242 run osmo-hlr_10.42.42.2(pid=14898): stderr: | [0;m[1;31m20221210134146378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134146378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134146378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134146378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134146378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134146378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134146394 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134146402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134146402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134146402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:49.670906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14897): Terminating (SIGTERM) 13:41:49.709964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14900): Terminating (SIGTERM) 13:41:49.749028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14903): Terminating (SIGTERM) 13:41:49.788934 --- ParallelTerminationStrategy: PID 14897 died... 13:41:49.807796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14897): Terminated: ok {rc=0} 13:41:49.850929 --- ParallelTerminationStrategy: PID 14900 died... 13:41:49.869256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14900): Terminated: ok {rc=0} 13:41:49.912466 --- ParallelTerminationStrategy: PID 14903 died... 13:41:49.930884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14903): Terminated: ok {rc=0} 13:41:50.015359 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:41:51.314716 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:41:51.321396 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:41:51.349863 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:41:51.383274 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:41:51.433295 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:41:51.461600 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:41:51.495169 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:41:52.057367 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:41:52.062289 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:41:52.073496 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:41:52.135717 tst switch_tch_pdch.py: using LAC 28787 13:41:52.248601 tst switch_tch_pdch.py: using RAC 227 13:41:52.364588 tst switch_tch_pdch.py: using CellId 28787 13:41:52.479795 tst switch_tch_pdch.py: using BVCI 28788 13:41:52.585077 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:41:52.596126 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:41:52.607025 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:41:52.617956 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:41:52.628888 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:41:52.639729 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:41:52.650740 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:41:52.661660 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:41:52.778882 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:41:52.895990 tst switch_tch_pdch.py:51: start network... 13:41:53.106561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:53.586293 run create_hlr_db(pid=14910): Launched 13:41:53.704741 bus /gobi_6: Setting Powered False 13:41:54.766500 run create_hlr_db(pid=14910): Terminated: ok {rc=0} 13:41:55.182273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14912): Launched 13:41:55.472793 run osmo-hlr_10.42.42.2(pid=14913): Launched 13:41:55.584424 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:56.088157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14915): Launched 13:41:56.379141 run osmo-stp_10.42.42.5(pid=14916): Launched 13:41:56.488802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:41:56.990256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14918): Launched 13:41:57.100465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:57.346146 run patchelf(pid=14919): Launched 13:41:57.507047 run osmo-stp_10.42.42.5(pid=14916): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14916)] 13:41:57.630177 run osmo-stp_10.42.42.5(pid=14916): stdout: | (launched: 2022-12-10_13:41:56.325505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:57.754389 run osmo-stp_10.42.42.5(pid=14916): stderr: | [0;m[38;5;43m20221210134156494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134156494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134156494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134156495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134156497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134156497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134156497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:57.879185 run osmo-stp_10.42.42.5(pid=14916): stdout: | (launched: 2022-12-10_13:41:56.325505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:57.998544 run osmo-stp_10.42.42.5(pid=14916): stderr: | [0;m[38;5;43m20221210134156494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134156494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134156494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134156495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134156497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134156497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134156497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:58.139983 run patchelf(pid=14919): Terminating (SIGINT) 13:41:58.304765 run patchelf(pid=14919): Terminated: ok {rc=0} 13:41:58.422732 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14916): Process ended prematurely: osmo-stp_10.42.42.5(pid=14916) [trial-2375↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14916)] [trial-2375↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:41:58.431486 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:41:58.457576 run osmo-hlr_10.42.42.2(pid=14913): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14913)] 13:41:58.504350 run osmo-hlr_10.42.42.2(pid=14913): stdout: | (launched: 2022-12-10_13:41:55.419386) 13:41:58.552785 run osmo-hlr_10.42.42.2(pid=14913): stderr: | [0;m[1;31m20221210134155593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134155593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134155593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134155593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134155593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134155593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134155606 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134155616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134155616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134155616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:58.601509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14912): Terminating (SIGTERM) 13:41:58.640556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14915): Terminating (SIGTERM) 13:41:58.679556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14918): Terminating (SIGTERM) 13:41:58.718734 --- ParallelTerminationStrategy: PID 14912 died... 13:41:58.737446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14912): Terminated: ok {rc=0} 13:41:58.780608 --- ParallelTerminationStrategy: PID 14915 died... 13:41:58.799011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14915): Terminated: ok {rc=0} 13:41:58.842002 --- ParallelTerminationStrategy: PID 14918 died... 13:41:58.860250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14918): Terminated: ok {rc=0} 13:41:58.944019 bus /gobi_0: Setting Powered False 13:42:00.041905 bus /gobi_0: Setting Powered False 13:42:01.160110 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:42:02.430065 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:42:02.435676 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:42:02.463999 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:42:02.497458 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:42:02.548248 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:42:02.576359 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:42:02.609699 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:42:03.167366 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:42:03.172235 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:42:03.183166 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:42:03.246596 tst switch_tch_pdch.py: using LAC 28788 13:42:03.364614 tst switch_tch_pdch.py: using RAC 228 13:42:03.478408 tst switch_tch_pdch.py: using CellId 28788 13:42:03.590446 tst switch_tch_pdch.py: using BVCI 28789 13:42:03.695341 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:42:03.706228 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:42:03.716838 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:42:03.727650 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:42:03.738276 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:42:03.748904 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:42:03.759704 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:42:03.770374 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:42:03.886549 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:42:04.004236 tst switch_tch_pdch.py:51: start network... 13:42:04.213722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:04.667489 run create_hlr_db(pid=14933): Launched 13:42:04.786909 bus /gobi_6: Setting Powered False 13:42:05.848392 run create_hlr_db(pid=14933): Terminated: ok {rc=0} 13:42:06.254415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14935): Launched 13:42:06.563724 run osmo-hlr_10.42.42.2(pid=14936): Launched 13:42:06.683098 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:07.195244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14938): Launched 13:42:07.505212 run osmo-stp_10.42.42.5(pid=14939): Launched 13:42:07.624319 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:08.133525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14941): Launched 13:42:08.252534 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:08.515740 run patchelf(pid=14942): Launched 13:42:08.688116 run osmo-stp_10.42.42.5(pid=14939): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14939)] 13:42:08.820281 run osmo-stp_10.42.42.5(pid=14939): stdout: | (launched: 2022-12-10_13:42:07.448622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:08.953886 run osmo-stp_10.42.42.5(pid=14939): stderr: | [0;m[38;5;43m20221210134207638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134207638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134207638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134207638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134207641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134207641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134207641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:09.087786 run osmo-stp_10.42.42.5(pid=14939): stdout: | (launched: 2022-12-10_13:42:07.448622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:09.216050 run osmo-stp_10.42.42.5(pid=14939): stderr: | [0;m[38;5;43m20221210134207638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134207638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134207638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134207638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134207641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134207641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134207641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:09.367832 run patchelf(pid=14942): Terminating (SIGINT) 13:42:09.543243 run patchelf(pid=14942): Terminated: ok {rc=0} 13:42:09.669546 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14939): Process ended prematurely: osmo-stp_10.42.42.5(pid=14939) [trial-2375↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14939)] [trial-2375↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:42:09.679003 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 13:42:09.706958 run osmo-hlr_10.42.42.2(pid=14936): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14936)] 13:42:09.756568 run osmo-hlr_10.42.42.2(pid=14936): stdout: | (launched: 2022-12-10_13:42:06.507049) 13:42:09.807817 run osmo-hlr_10.42.42.2(pid=14936): stderr: | [0;m[1;31m20221210134206705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134206705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134206705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134206705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134206705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134206705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134206718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134206726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134206726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134206726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:09.859539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14935): Terminating (SIGTERM) 13:42:09.900934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14938): Terminating (SIGTERM) 13:42:09.942458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14941): Terminating (SIGTERM) 13:42:09.984279 --- ParallelTerminationStrategy: PID 14935 died... 13:42:10.004262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14935): Terminated: ok {rc=0} 13:42:10.050307 --- ParallelTerminationStrategy: PID 14938 died... 13:42:10.070046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14938): Terminated: ok {rc=0} 13:42:10.115740 --- ParallelTerminationStrategy: PID 14941 died... 13:42:10.134944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14941): Terminated: ok {rc=0} 13:42:10.221556 bus /gobi_0: Setting Powered False 13:42:11.319112 bus /gobi_0: Setting Powered False 13:42:12.434759 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_sms:nanobts --------------------------------------------------------------------- 13:42:13.676305 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:42:13.679943 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 13:42:13.703035 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 13:42:13.709798 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 13:42:13.762979 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 13:42:13.788629 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 13:42:13.798031 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 13:42:14.326706 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 13:42:14.331564 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 13:42:14.342283 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 13:42:14.379254 tst mo_mt_sms.py: using LAC 28789 13:42:14.496808 tst mo_mt_sms.py: using RAC 229 13:42:14.612040 tst mo_mt_sms.py: using CellId 28789 13:42:14.724536 tst mo_mt_sms.py: using BVCI 28790 13:42:14.829389 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 13:42:14.943941 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 13:42:15.056920 tst mo_mt_sms.py:9: start nitb and bts... 13:42:15.252153 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:42:15.861696 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14946): Launched 13:42:16.183023 run osmo-nitb_10.42.42.2(pid=14947): Launched 13:42:16.358798 run osmo-nitb_10.42.42.2(pid=14947): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14947)] 13:42:16.493204 run osmo-nitb_10.42.42.2(pid=14947): stdout: | (launched: 2022-12-10_13:42:16.114087) 13:42:16.629456 run osmo-nitb_10.42.42.2(pid=14947): stderr: | (launched: 2022-12-10_13:42:16.158545) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:42:16.765162 run osmo-nitb_10.42.42.2(pid=14947): stdout: | (launched: 2022-12-10_13:42:16.114087) 13:42:16.895461 run osmo-nitb_10.42.42.2(pid=14947): stderr: | (launched: 2022-12-10_13:42:16.158545) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14947): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14947) [trial-2375↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14947)] 13:42:17.305775 tst osmo-nitb_10.42.42.2(pid=14947): stdout: | (launched: 2022-12-10_13:42:16.114087) 13:42:17.423206 tst osmo-nitb_10.42.42.2(pid=14947): stderr: | (launched: 2022-12-10_13:42:16.158545) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:42:17.562094 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14947): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14947) [trial-2375↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14947)] [trial-2375↪nitb_sms:nanobts↪mo_mt_sms.py:11] 13:42:17.570356 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 13:42:17.576875 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14946): Terminating (SIGTERM) 13:42:17.785202 --- ParallelTerminationStrategy: PID 14946 died... 13:42:17.805187 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14946): Terminated: ok {rc=0} 13:42:17.889300 bus /sierra_3: Setting Powered False 13:42:18.990316 bus /sierra_3: Setting Powered False 13:42:20.106956 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 sms:nanobts+band-1900 --------------------------------------------------------------------- 13:42:21.289329 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:42:21.294551 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:42:21.318602 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 13:42:21.345612 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 13:42:21.398780 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:42:21.423727 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 13:42:21.450950 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 13:42:21.993984 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 13:42:21.999022 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:42:22.009750 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:42:22.049784 tst mo_mt_sms.py: using LAC 28790 13:42:22.164652 tst mo_mt_sms.py: using RAC 230 13:42:22.277226 tst mo_mt_sms.py: using CellId 28790 13:42:22.392896 tst mo_mt_sms.py: using BVCI 28791 13:42:22.498817 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:42:22.509355 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:42:22.519677 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:42:22.529936 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:42:22.540077 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:42:22.550261 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 13:42:22.667225 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 13:42:22.785326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:23.266671 run create_hlr_db(pid=14951): Launched 13:42:23.386496 bus /sierra_2: Setting Powered False 13:42:24.448090 run create_hlr_db(pid=14951): Terminated: ok {rc=0} 13:42:24.864926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14953): Launched 13:42:25.155456 run osmo-hlr_10.42.42.2(pid=14954): Launched 13:42:25.266592 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:25.765553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14956): Launched 13:42:26.056365 run osmo-stp_10.42.42.5(pid=14957): Launched 13:42:26.166074 run osmo-msc_10.42.42.6: Starting osmo-msc 13:42:26.692003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14959): Launched 13:42:26.981992 run osmo-msc_10.42.42.6(pid=14960): Launched 13:42:27.144460 run osmo-stp_10.42.42.5(pid=14957): ERR: Terminated: ERROR {rc=1} [trial-2375↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14957)] 13:42:27.268380 run osmo-stp_10.42.42.5(pid=14957): stdout: | (launched: 2022-12-10_13:42:26.002921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:27.393176 run osmo-stp_10.42.42.5(pid=14957): stderr: | [0;m[38;5;43m20221210134226173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134226173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134226173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134226173 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134226174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134226174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134226174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:27.514228 run osmo-stp_10.42.42.5(pid=14957): stdout: | (launched: 2022-12-10_13:42:26.002921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:27.629953 run osmo-stp_10.42.42.5(pid=14957): stderr: | [0;m[38;5;43m20221210134226173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134226173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134226173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134226173 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134226174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134226174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134226174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:27.768033 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14957): Process ended prematurely: osmo-stp_10.42.42.5(pid=14957) [trial-2375↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14957)] [trial-2375↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 13:42:27.776120 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 13:42:27.801748 run osmo-hlr_10.42.42.2(pid=14954): ERR: Terminated: ERROR {rc=237} [trial-2375↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14954)] 13:42:27.848206 run osmo-hlr_10.42.42.2(pid=14954): stdout: | (launched: 2022-12-10_13:42:25.102435) 13:42:27.896856 run osmo-hlr_10.42.42.2(pid=14954): stderr: | [0;m[1;31m20221210134225278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134225278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134225278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134225279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134225279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134225279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134225291 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134225300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134225300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134225300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:27.964015 run osmo-msc_10.42.42.6(pid=14960): ERR: Terminated: ERROR {rc=2} [trial-2375↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14960)] 13:42:28.010656 run osmo-msc_10.42.42.6(pid=14960): stdout: | (launched: 2022-12-10_13:42:26.928560) 13:42:28.058535 run osmo-msc_10.42.42.6(pid=14960): stderr: | [0;m[38;5;43m20221210134227201 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134227201 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fac5d671c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134227201 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134227201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134227201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134227202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134227203 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134227204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134227204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134227204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:42:28.106802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14953): Terminating (SIGTERM) 13:42:28.145557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14956): Terminating (SIGTERM) 13:42:28.184371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14959): Terminating (SIGTERM) 13:42:28.223412 --- ParallelTerminationStrategy: PID 14953 died... 13:42:28.242100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14953): Terminated: ok {rc=0} 13:42:28.285206 --- ParallelTerminationStrategy: PID 14956 died... 13:42:28.303486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14956): Terminated: ok {rc=0} 13:42:28.346347 --- ParallelTerminationStrategy: PID 14959 died... 13:42:28.364575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14959): Terminated: ok {rc=0} 13:42:28.446613 bus /sierra_3: Setting Powered False 13:42:29.542298 bus /sierra_3: Setting Powered False 13:42:30.659429 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 13:42:31.894394 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:42:31.899743 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:42:31.925519 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 13:42:31.933625 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 13:42:31.971715 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:42:32.010657 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 13:42:32.020818 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 13:42:32.520684 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2375 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 13:42:32.525826 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 13:42:32.536862 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:42:32.581215 tst assert_extension.py: using LAC 28791 13:42:32.702757 tst assert_extension.py: using RAC 231 13:42:32.822998 tst assert_extension.py: using CellId 28791 13:42:32.943898 tst assert_extension.py: using BVCI 28792 13:42:33.057646 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 13:42:33.176273 tst assert_extension.py:10: start nitb and bts... 13:42:33.385174 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:42:34.018372 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14965): Launched 13:42:34.328294 run osmo-nitb_10.42.42.2(pid=14966): Launched 13:42:34.501115 run osmo-nitb_10.42.42.2(pid=14966): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14966)] 13:42:34.640561 run osmo-nitb_10.42.42.2(pid=14966): stdout: | (launched: 2022-12-10_13:42:34.271701) 13:42:34.781135 run osmo-nitb_10.42.42.2(pid=14966): stderr: | (launched: 2022-12-10_13:42:34.318332) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:42:34.921396 run osmo-nitb_10.42.42.2(pid=14966): stdout: | (launched: 2022-12-10_13:42:34.271701) 13:42:35.057057 run osmo-nitb_10.42.42.2(pid=14966): stderr: | (launched: 2022-12-10_13:42:34.318332) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14966): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14966) [trial-2375↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14966)] 13:42:35.445640 tst osmo-nitb_10.42.42.2(pid=14966): stdout: | (launched: 2022-12-10_13:42:34.271701) 13:42:35.570571 tst osmo-nitb_10.42.42.2(pid=14966): stderr: | (launched: 2022-12-10_13:42:34.318332) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:42:35.718315 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14966): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14966) [trial-2375↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14966)] [trial-2375↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 13:42:35.727330 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:42:35.734258 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14965): Terminating (SIGTERM) 13:42:35.945511 --- ParallelTerminationStrategy: PID 14965 died... 13:42:35.967822 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14965): Terminated: ok {rc=0} 13:42:36.056565 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 ussd:nanobts+band-1900 --------------------------------------------------------------------- 13:42:37.219456 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:42:37.224791 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:42:37.249130 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 13:42:37.276203 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 13:42:37.311020 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:42:37.335193 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 13:42:37.362271 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 13:42:37.892228 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2375 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 13:42:37.898362 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:42:37.909528 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:42:37.946025 tst assert_extension.py: using LAC 28792 13:42:38.060784 tst assert_extension.py: using RAC 232 13:42:38.174486 tst assert_extension.py: using CellId 28792 13:42:38.289124 tst assert_extension.py: using BVCI 28793 13:42:38.395055 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:42:38.405570 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:42:38.415880 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:42:38.426292 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:42:38.436579 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:42:38.446935 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 13:42:38.562094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:39.043321 run create_hlr_db(pid=14970): Launched 13:42:39.162474 bus /sierra_2: Setting Powered False 13:42:40.219986 run create_hlr_db(pid=14970): Terminated: ok {rc=0} 13:42:40.636003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14972): Launched 13:42:40.926481 run osmo-hlr_10.42.42.2(pid=14973): Launched 13:42:41.036737 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:41.552616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14975): Launched 13:42:41.842302 run osmo-stp_10.42.42.5(pid=14976): Launched 13:42:41.953134 run osmo-msc_10.42.42.6: Starting osmo-msc 13:42:42.478471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14978): Launched 13:42:42.769919 run osmo-msc_10.42.42.6(pid=14979): Launched 13:42:42.932403 run osmo-stp_10.42.42.5(pid=14976): ERR: Terminated: ERROR {rc=1} [trial-2375↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14976)] 13:42:43.056057 run osmo-stp_10.42.42.5(pid=14976): stdout: | (launched: 2022-12-10_13:42:41.789018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:43.180497 run osmo-stp_10.42.42.5(pid=14976): stderr: | [0;m[38;5;43m20221210134241958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134241958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134241959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134241959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134241960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134241960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134241960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:43.301832 run osmo-stp_10.42.42.5(pid=14976): stdout: | (launched: 2022-12-10_13:42:41.789018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:43.417302 run osmo-stp_10.42.42.5(pid=14976): stderr: | [0;m[38;5;43m20221210134241958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134241958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134241959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134241959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134241960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134241960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134241960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:43.555673 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14976): Process ended prematurely: osmo-stp_10.42.42.5(pid=14976) [trial-2375↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14976)] [trial-2375↪ussd:nanobts+band-1900↪assert_extension.py:17] 13:42:43.563741 tst assert_extension.py:17: Test FAILED (5.7 sec) 13:42:43.589229 run osmo-hlr_10.42.42.2(pid=14973): ERR: Terminated: ERROR {rc=237} [trial-2375↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14973)] 13:42:43.636421 run osmo-hlr_10.42.42.2(pid=14973): stdout: | (launched: 2022-12-10_13:42:40.873375) 13:42:43.685145 run osmo-hlr_10.42.42.2(pid=14973): stderr: | [0;m[1;31m20221210134241046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134241046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134241046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134241046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134241046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134241046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134241059 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134241069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134241069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134241069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:43.753158 run osmo-msc_10.42.42.6(pid=14979): ERR: Terminated: ERROR {rc=2} [trial-2375↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14979)] 13:42:43.800239 run osmo-msc_10.42.42.6(pid=14979): stdout: | (launched: 2022-12-10_13:42:42.716472) 13:42:43.848786 run osmo-msc_10.42.42.6(pid=14979): stderr: | [0;m[38;5;43m20221210134242986 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134242986 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f60bfa07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134242986 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134242986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134242986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134242986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134242988 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134242988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134242988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134242989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:42:43.898180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14972): Terminating (SIGTERM) 13:42:43.937156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14975): Terminating (SIGTERM) 13:42:43.976305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14978): Terminating (SIGTERM) 13:42:44.015695 --- ParallelTerminationStrategy: PID 14972 died... 13:42:44.034523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14972): Terminated: ok {rc=0} 13:42:44.077763 --- ParallelTerminationStrategy: PID 14975 died... 13:42:44.095924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14975): Terminated: ok {rc=0} 13:42:44.139151 --- ParallelTerminationStrategy: PID 14978 died... 13:42:44.157382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14978): Terminated: ok {rc=0} 13:42:44.238707 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:42:45.438129 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:42:45.446252 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:42:45.471377 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:42:45.498240 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:42:45.550236 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:42:45.574200 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:42:45.601472 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:42:46.153646 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:42:46.216135 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:42:46.227830 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:42:46.285775 tst mo_mt_call.py: using LAC 28793 13:42:46.412625 tst mo_mt_call.py: using RAC 233 13:42:46.535985 tst mo_mt_call.py: using CellId 28793 13:42:46.655567 tst mo_mt_call.py: using BVCI 28794 13:42:46.769141 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:42:46.781206 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:42:46.792925 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:42:46.805374 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:42:46.816823 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:42:46.828459 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:42:46.964899 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:42:47.090163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:47.604184 run create_hlr_db(pid=14984): Launched 13:42:47.726156 bus /sierra_2: Setting Powered False 13:42:48.788509 run create_hlr_db(pid=14984): Terminated: ok {rc=0} 13:42:49.211678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14986): Launched 13:42:49.507535 run osmo-hlr_10.42.42.2(pid=14987): Launched 13:42:49.622101 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:50.169249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14989): Launched 13:42:50.483807 run osmo-stp_10.42.42.5(pid=14990): Launched 13:42:50.603841 run osmo-msc_10.42.42.6: Starting osmo-msc 13:42:51.175511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14992): Launched 13:42:51.490863 run osmo-msc_10.42.42.6(pid=14993): Launched 13:42:51.668066 run osmo-stp_10.42.42.5(pid=14990): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14990)] 13:42:51.802222 run osmo-stp_10.42.42.5(pid=14990): stdout: | (launched: 2022-12-10_13:42:50.426826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:52.000141 run osmo-stp_10.42.42.5(pid=14990): stderr: | [0;m[38;5;43m20221210134250619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134250619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134250619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134250620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134250622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134250622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134250622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:52.133158 run osmo-stp_10.42.42.5(pid=14990): stdout: | (launched: 2022-12-10_13:42:50.426826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:52.258798 run osmo-stp_10.42.42.5(pid=14990): stderr: | [0;m[38;5;43m20221210134250619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134250619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134250619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134250620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134250622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134250622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134250622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:52.409371 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14990): Process ended prematurely: osmo-stp_10.42.42.5(pid=14990) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14990)] [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:42:52.418714 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:42:52.446598 run osmo-hlr_10.42.42.2(pid=14987): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14987)] 13:42:52.496506 run osmo-hlr_10.42.42.2(pid=14987): stdout: | (launched: 2022-12-10_13:42:49.453860) 13:42:52.547817 run osmo-hlr_10.42.42.2(pid=14987): stderr: | [0;m[1;31m20221210134249627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134249627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134249627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134249627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134249627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134249627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134249639 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134249648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134249648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134249648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:52.619646 run osmo-msc_10.42.42.6(pid=14993): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14993)] 13:42:52.669376 run osmo-msc_10.42.42.6(pid=14993): stdout: | (launched: 2022-12-10_13:42:51.433698) 13:42:52.720392 run osmo-msc_10.42.42.6(pid=14993): stderr: | [0;m[38;5;43m20221210134251755 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134251755 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4400cf4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134251755 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134251755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134251756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134251756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134251758 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134251758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134251758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134251758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:42:52.771941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14986): Terminating (SIGTERM) 13:42:52.812938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14989): Terminating (SIGTERM) 13:42:52.854167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14992): Terminating (SIGTERM) 13:42:52.895666 --- ParallelTerminationStrategy: PID 14986 died... 13:42:52.915293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14986): Terminated: ok {rc=0} 13:42:52.961374 --- ParallelTerminationStrategy: PID 14989 died... 13:42:52.980373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14989): Terminated: ok {rc=0} 13:42:53.026657 --- ParallelTerminationStrategy: PID 14992 died... 13:42:53.045873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14992): Terminated: ok {rc=0} 13:42:53.132793 bus /sierra_3: Setting Powered False 13:42:54.230771 bus /sierra_3: Setting Powered False 13:42:55.345211 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:42:56.492127 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:42:56.504351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:42:56.564711 tst mo_mt_call_osmux.py: using LAC 28794 13:42:56.690722 tst mo_mt_call_osmux.py: using RAC 234 13:42:56.814364 tst mo_mt_call_osmux.py: using CellId 28794 13:42:56.938715 tst mo_mt_call_osmux.py: using BVCI 28795 13:42:57.054311 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:42:57.065863 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:42:57.077419 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:42:57.088908 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:42:57.100710 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:42:57.112292 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:42:57.227190 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:42:57.345724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:57.838696 run create_hlr_db(pid=14995): Launched 13:42:57.959205 bus /sierra_2: Setting Powered False 13:42:59.022203 run create_hlr_db(pid=14995): Terminated: ok {rc=0} 13:42:59.445874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14997): Launched 13:42:59.741737 run osmo-hlr_10.42.42.2(pid=14998): Launched 13:42:59.854810 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:00.365510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15000): Launched 13:43:00.661936 run osmo-stp_10.42.42.5(pid=15001): Launched 13:43:00.775353 run osmo-msc_10.42.42.6: Starting osmo-msc 13:43:01.393790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15003): Launched 13:43:01.709700 run osmo-msc_10.42.42.6(pid=15004): Launched 13:43:02.065464 run osmo-stp_10.42.42.5(pid=15001): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15001)] 13:43:02.321352 run osmo-stp_10.42.42.5(pid=15001): stdout: | (launched: 2022-12-10_13:43:00.607613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:02.445614 run osmo-stp_10.42.42.5(pid=15001): stderr: | [0;m[38;5;43m20221210134300777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134300777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134300777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134300778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134300780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134300780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134300780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:02.568385 run osmo-stp_10.42.42.5(pid=15001): stdout: | (launched: 2022-12-10_13:43:00.607613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:02.686099 run osmo-stp_10.42.42.5(pid=15001): stderr: | [0;m[38;5;43m20221210134300777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134300777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134300777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134300778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134300780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134300780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134300780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:02.827017 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15001): Process ended prematurely: osmo-stp_10.42.42.5(pid=15001) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15001)] [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:43:02.835839 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:43:02.862205 run osmo-hlr_10.42.42.2(pid=14998): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14998)] 13:43:02.909610 run osmo-hlr_10.42.42.2(pid=14998): stdout: | (launched: 2022-12-10_13:42:59.687485) 13:43:02.958593 run osmo-hlr_10.42.42.2(pid=14998): stderr: | [0;m[1;31m20221210134259862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134259862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134259862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134259863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134259863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134259863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134259875 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134259884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134259884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134259884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:03.027077 run osmo-msc_10.42.42.6(pid=15004): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15004)] 13:43:03.074314 run osmo-msc_10.42.42.6(pid=15004): stdout: | (launched: 2022-12-10_13:43:01.640316) 13:43:03.123388 run osmo-msc_10.42.42.6(pid=15004): stderr: | [0;m[38;5;43m20221210134302131 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134302131 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9620816c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134302132 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134302133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134302133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134302135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134302142 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134302143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134302143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134302143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:43:03.173245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14997): Terminating (SIGTERM) 13:43:03.212599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15000): Terminating (SIGTERM) 13:43:03.251901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15003): Terminating (SIGTERM) 13:43:03.291510 --- ParallelTerminationStrategy: PID 14997 died... 13:43:03.310489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14997): Terminated: ok {rc=0} 13:43:03.353774 --- ParallelTerminationStrategy: PID 15000 died... 13:43:03.372073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15000): Terminated: ok {rc=0} 13:43:03.416331 --- ParallelTerminationStrategy: PID 15003 died... 13:43:03.434857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15003): Terminated: ok {rc=0} 13:43:03.519183 bus /sierra_3: Setting Powered False 13:43:04.618103 bus /sierra_3: Setting Powered False 13:43:05.729341 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:43:06.971161 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:43:06.979136 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:43:07.004463 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:43:07.032241 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:43:07.085961 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:43:07.110578 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:43:07.137733 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:43:07.687161 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:43:07.738417 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:43:07.749991 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:43:07.813723 tst mo_mt_call.py: using LAC 28795 13:43:07.930811 tst mo_mt_call.py: using RAC 235 13:43:08.046050 tst mo_mt_call.py: using CellId 28795 13:43:08.161996 tst mo_mt_call.py: using BVCI 28796 13:43:08.278692 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:43:08.290307 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:43:08.301775 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:43:08.313490 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:43:08.325271 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:43:08.336786 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:43:08.451168 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:43:08.568146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:09.026918 run create_hlr_db(pid=15009): Launched 13:43:09.147993 bus /sierra_2: Setting Powered False 13:43:10.206518 run create_hlr_db(pid=15009): Terminated: ok {rc=0} 13:43:10.617632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15011): Launched 13:43:10.913038 run osmo-hlr_10.42.42.2(pid=15012): Launched 13:43:11.025159 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:11.549235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15014): Launched 13:43:11.844745 run osmo-stp_10.42.42.5(pid=15015): Launched 13:43:11.957343 run osmo-msc_10.42.42.6: Starting osmo-msc 13:43:12.492151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15017): Launched 13:43:12.787577 run osmo-msc_10.42.42.6(pid=15018): Launched 13:43:12.953683 run osmo-stp_10.42.42.5(pid=15015): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15015)] 13:43:13.078767 run osmo-stp_10.42.42.5(pid=15015): stdout: | (launched: 2022-12-10_13:43:11.790357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:13.204196 run osmo-stp_10.42.42.5(pid=15015): stderr: | [0;m[38;5;43m20221210134311961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134311961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134311961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134311962 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134311962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134311962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134311962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:13.327223 run osmo-stp_10.42.42.5(pid=15015): stdout: | (launched: 2022-12-10_13:43:11.790357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:13.444455 run osmo-stp_10.42.42.5(pid=15015): stderr: | [0;m[38;5;43m20221210134311961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134311961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134311961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134311962 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134311962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134311962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134311962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:13.584813 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15015): Process ended prematurely: osmo-stp_10.42.42.5(pid=15015) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15015)] [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:43:13.593670 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 13:43:13.619440 run osmo-hlr_10.42.42.2(pid=15012): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15012)] 13:43:13.666307 run osmo-hlr_10.42.42.2(pid=15012): stdout: | (launched: 2022-12-10_13:43:10.859177) 13:43:13.714814 run osmo-hlr_10.42.42.2(pid=15012): stderr: | [0;m[1;31m20221210134311035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134311035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134311035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134311035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134311035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134311036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134311048 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134311058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134311058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134311058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:13.782160 run osmo-msc_10.42.42.6(pid=15018): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15018)] 13:43:13.828871 run osmo-msc_10.42.42.6(pid=15018): stdout: | (launched: 2022-12-10_13:43:12.733478) 13:43:13.877095 run osmo-msc_10.42.42.6(pid=15018): stderr: | [0;m[38;5;43m20221210134313003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134313004 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f04e483ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134313004 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134313004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134313004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134313005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134313006 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134313007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134313007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134313007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:43:13.925983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15011): Terminating (SIGTERM) 13:43:13.964829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15014): Terminating (SIGTERM) 13:43:14.003648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15017): Terminating (SIGTERM) 13:43:14.042818 --- ParallelTerminationStrategy: PID 15011 died... 13:43:14.061544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15011): Terminated: ok {rc=0} 13:43:14.104795 --- ParallelTerminationStrategy: PID 15014 died... 13:43:14.123203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15014): Terminated: ok {rc=0} 13:43:14.166549 --- ParallelTerminationStrategy: PID 15017 died... 13:43:14.184645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15017): Terminated: ok {rc=0} 13:43:14.268235 bus /sierra_3: Setting Powered False 13:43:15.364240 bus /sierra_3: Setting Powered False 13:43:16.478760 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:43:17.618660 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:43:17.630184 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:43:17.693415 tst mo_mt_call_osmux.py: using LAC 28796 13:43:17.811531 tst mo_mt_call_osmux.py: using RAC 236 13:43:17.927041 tst mo_mt_call_osmux.py: using CellId 28796 13:43:18.042868 tst mo_mt_call_osmux.py: using BVCI 28797 13:43:18.152357 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:43:18.163284 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:43:18.174157 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:43:18.184845 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:43:18.195686 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:43:18.206444 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:43:18.319159 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:43:18.433528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:18.892091 run create_hlr_db(pid=15020): Launched 13:43:19.012147 bus /sierra_2: Setting Powered False 13:43:20.070928 run create_hlr_db(pid=15020): Terminated: ok {rc=0} 13:43:20.503104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15022): Launched 13:43:20.819159 run osmo-hlr_10.42.42.2(pid=15023): Launched 13:43:20.940895 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:21.491566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15025): Launched 13:43:21.808168 run osmo-stp_10.42.42.5(pid=15026): Launched 13:43:21.929866 run osmo-msc_10.42.42.6: Starting osmo-msc 13:43:22.504557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15028): Launched 13:43:22.802206 run osmo-msc_10.42.42.6(pid=15029): Launched 13:43:22.968342 run osmo-stp_10.42.42.5(pid=15026): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15026)] 13:43:23.093755 run osmo-stp_10.42.42.5(pid=15026): stdout: | (launched: 2022-12-10_13:43:21.750821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:23.219833 run osmo-stp_10.42.42.5(pid=15026): stderr: | [0;m[38;5;43m20221210134321940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134321940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134321940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134321940 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134321943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134321943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134321943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:23.343659 run osmo-stp_10.42.42.5(pid=15026): stdout: | (launched: 2022-12-10_13:43:21.750821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:23.461677 run osmo-stp_10.42.42.5(pid=15026): stderr: | [0;m[38;5;43m20221210134321940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134321940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134321940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134321940 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134321943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134321943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134321943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:23.602730 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15026): Process ended prematurely: osmo-stp_10.42.42.5(pid=15026) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15026)] [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:43:23.611489 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:43:23.637450 run osmo-hlr_10.42.42.2(pid=15023): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15023)] 13:43:23.684381 run osmo-hlr_10.42.42.2(pid=15023): stdout: | (launched: 2022-12-10_13:43:20.761822) 13:43:23.732824 run osmo-hlr_10.42.42.2(pid=15023): stderr: | [0;m[1;31m20221210134320959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134320960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134320960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134320960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134320960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134320960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134320972 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134320981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134320981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134320981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:23.800492 run osmo-msc_10.42.42.6(pid=15029): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15029)] 13:43:23.847326 run osmo-msc_10.42.42.6(pid=15029): stdout: | (launched: 2022-12-10_13:43:22.747719) 13:43:23.895478 run osmo-msc_10.42.42.6(pid=15029): stderr: | [0;m[38;5;43m20221210134323021 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134323021 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe524e8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134323022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134323022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134323022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134323022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134323024 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134323024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134323024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134323024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:43:23.944129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15022): Terminating (SIGTERM) 13:43:23.983171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15025): Terminating (SIGTERM) 13:43:24.022796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15028): Terminating (SIGTERM) 13:43:24.062669 --- ParallelTerminationStrategy: PID 15022 died... 13:43:24.081530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15022): Terminated: ok {rc=0} 13:43:24.125236 --- ParallelTerminationStrategy: PID 15025 died... 13:43:24.143651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15025): Terminated: ok {rc=0} 13:43:24.186825 --- ParallelTerminationStrategy: PID 15028 died... 13:43:24.206276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15028): Terminated: ok {rc=0} 13:43:24.289348 bus /sierra_3: Setting Powered False 13:43:25.386150 bus /sierra_3: Setting Powered False 13:43:26.501381 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:43:27.743916 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:43:27.751791 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:43:27.776409 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:43:27.803557 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:43:27.854515 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:43:27.877839 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:43:27.904288 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:43:28.455309 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:43:28.502693 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:43:28.513843 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:43:28.570461 tst mo_mt_call.py: using LAC 28797 13:43:28.687583 tst mo_mt_call.py: using RAC 237 13:43:28.802544 tst mo_mt_call.py: using CellId 28797 13:43:28.917793 tst mo_mt_call.py: using BVCI 28798 13:43:29.025640 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:43:29.036473 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:43:29.047330 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:43:29.058230 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:43:29.069165 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:43:29.079884 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:43:29.197478 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:43:29.318385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:29.810376 run create_hlr_db(pid=15035): Launched 13:43:29.931362 bus /sierra_2: Setting Powered False 13:43:31.004855 run create_hlr_db(pid=15035): Terminated: ok {rc=0} 13:43:31.488461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15037): Launched 13:43:31.803295 run osmo-hlr_10.42.42.2(pid=15038): Launched 13:43:32.059127 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:32.714834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15040): Launched 13:43:33.031046 run osmo-stp_10.42.42.5(pid=15041): Launched 13:43:33.152736 run osmo-msc_10.42.42.6: Starting osmo-msc 13:43:33.725023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15043): Launched 13:43:34.041079 run osmo-msc_10.42.42.6(pid=15044): Launched 13:43:34.219486 run osmo-stp_10.42.42.5(pid=15041): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15041)] 13:43:34.354669 run osmo-stp_10.42.42.5(pid=15041): stdout: | (launched: 2022-12-10_13:43:32.973760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:34.489443 run osmo-stp_10.42.42.5(pid=15041): stderr: | [0;m[38;5;43m20221210134333165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134333166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134333166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134333166 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134333167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134333167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134333167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:34.623643 run osmo-stp_10.42.42.5(pid=15041): stdout: | (launched: 2022-12-10_13:43:32.973760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:34.749613 run osmo-stp_10.42.42.5(pid=15041): stderr: | [0;m[38;5;43m20221210134333165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134333166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134333166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134333166 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134333167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134333167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134333167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:34.900847 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15041): Process ended prematurely: osmo-stp_10.42.42.5(pid=15041) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15041)] [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:43:34.910548 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:43:34.938679 run osmo-hlr_10.42.42.2(pid=15038): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15038)] 13:43:34.988725 run osmo-hlr_10.42.42.2(pid=15038): stdout: | (launched: 2022-12-10_13:43:31.742187) 13:43:35.040362 run osmo-hlr_10.42.42.2(pid=15038): stderr: | [0;m[1;31m20221210134331999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134331999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134331999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134331999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134332000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134332000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134332015 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134332042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134332042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134332042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:35.112386 run osmo-msc_10.42.42.6(pid=15044): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15044)] 13:43:35.162249 run osmo-msc_10.42.42.6(pid=15044): stdout: | (launched: 2022-12-10_13:43:33.983482) 13:43:35.213434 run osmo-msc_10.42.42.6(pid=15044): stderr: | [0;m[38;5;43m20221210134334305 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134334305 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f758b7a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134334305 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134334305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134334305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134334306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134334307 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134334308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134334308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134334308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:43:35.265295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15037): Terminating (SIGTERM) 13:43:35.306805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15040): Terminating (SIGTERM) 13:43:35.348456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15043): Terminating (SIGTERM) 13:43:35.390316 --- ParallelTerminationStrategy: PID 15037 died... 13:43:35.410085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15037): Terminated: ok {rc=0} 13:43:35.456467 --- ParallelTerminationStrategy: PID 15040 died... 13:43:35.476004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15040): Terminated: ok {rc=0} 13:43:35.522265 --- ParallelTerminationStrategy: PID 15043 died... 13:43:35.541615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15043): Terminated: ok {rc=0} 13:43:35.628753 bus /sierra_3: Setting Powered False 13:43:36.725648 bus /sierra_3: Setting Powered False 13:43:37.836506 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:43:38.975813 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:43:38.987937 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:43:39.046613 tst mo_mt_call_osmux.py: using LAC 28798 13:43:39.165367 tst mo_mt_call_osmux.py: using RAC 238 13:43:39.286283 tst mo_mt_call_osmux.py: using CellId 28798 13:43:39.403465 tst mo_mt_call_osmux.py: using BVCI 28799 13:43:39.511010 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:43:39.522361 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:43:39.533454 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:43:39.544397 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:43:39.555518 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:43:39.567358 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:43:39.685441 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:43:39.803905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:40.295248 run create_hlr_db(pid=15046): Launched 13:43:40.416326 bus /sierra_2: Setting Powered False 13:43:41.479057 run create_hlr_db(pid=15046): Terminated: ok {rc=0} 13:43:41.919141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15049): Launched 13:43:42.235142 run osmo-hlr_10.42.42.2(pid=15050): Launched 13:43:42.356365 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:42.904134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15052): Launched 13:43:43.219921 run osmo-stp_10.42.42.5(pid=15053): Launched 13:43:43.341194 run osmo-msc_10.42.42.6: Starting osmo-msc 13:43:43.921111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15055): Launched 13:43:44.237948 run osmo-msc_10.42.42.6(pid=15056): Launched 13:43:44.416313 run osmo-stp_10.42.42.5(pid=15053): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15053)] 13:43:44.551158 run osmo-stp_10.42.42.5(pid=15053): stdout: | (launched: 2022-12-10_13:43:43.162958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:44.686156 run osmo-stp_10.42.42.5(pid=15053): stderr: | [0;m[38;5;43m20221210134343354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134343354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134343355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134343355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134343355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134343356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134343356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:44.820074 run osmo-stp_10.42.42.5(pid=15053): stdout: | (launched: 2022-12-10_13:43:43.162958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:44.946442 run osmo-stp_10.42.42.5(pid=15053): stderr: | [0;m[38;5;43m20221210134343354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134343354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134343355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134343355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134343355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134343356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134343356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:45.098240 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15053): Process ended prematurely: osmo-stp_10.42.42.5(pid=15053) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15053)] [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:43:45.107805 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:43:45.135932 run osmo-hlr_10.42.42.2(pid=15050): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15050)] 13:43:45.185797 run osmo-hlr_10.42.42.2(pid=15050): stdout: | (launched: 2022-12-10_13:43:42.178005) 13:43:45.237314 run osmo-hlr_10.42.42.2(pid=15050): stderr: | [0;m[1;31m20221210134342374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134342374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134342374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134342374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134342375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134342375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134342386 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134342395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134342395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134342395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:45.309187 run osmo-msc_10.42.42.6(pid=15056): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15056)] 13:43:45.358797 run osmo-msc_10.42.42.6(pid=15056): stdout: | (launched: 2022-12-10_13:43:44.180521) 13:43:45.410723 run osmo-msc_10.42.42.6(pid=15056): stderr: | [0;m[38;5;43m20221210134344502 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134344503 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f17387c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134344503 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134344503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134344503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134344503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134344505 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134344505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134344505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134344505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:43:45.462435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15049): Terminating (SIGTERM) 13:43:45.504199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15052): Terminating (SIGTERM) 13:43:45.545884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15055): Terminating (SIGTERM) 13:43:45.587782 --- ParallelTerminationStrategy: PID 15049 died... 13:43:45.607531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15049): Terminated: ok {rc=0} 13:43:45.653849 --- ParallelTerminationStrategy: PID 15052 died... 13:43:45.673266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15052): Terminated: ok {rc=0} 13:43:45.719227 --- ParallelTerminationStrategy: PID 15055 died... 13:43:45.738559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15055): Terminated: ok {rc=0} 13:43:45.825442 bus /sierra_3: Setting Powered False 13:43:46.964734 bus /sierra_3: Setting Powered False 13:43:48.093198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:43:49.328057 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:43:49.335183 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:43:49.358595 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:43:49.384443 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:43:49.434828 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:43:49.458175 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:43:49.484153 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:43:50.036563 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:43:50.084427 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:43:50.095710 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:43:50.154223 tst mo_mt_call.py: using LAC 28799 13:43:50.272091 tst mo_mt_call.py: using RAC 239 13:43:50.388892 tst mo_mt_call.py: using CellId 28799 13:43:50.507596 tst mo_mt_call.py: using BVCI 28800 13:43:50.616913 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:43:50.627960 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:43:50.638749 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:43:50.649745 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:43:50.660696 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:43:50.671712 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:43:50.788878 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:43:50.906983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:51.397520 run create_hlr_db(pid=15061): Launched 13:43:51.518737 bus /sierra_2: Setting Powered False 13:43:52.581531 run create_hlr_db(pid=15061): Terminated: ok {rc=0} 13:43:53.018912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15063): Launched 13:43:53.333665 run osmo-hlr_10.42.42.2(pid=15064): Launched 13:43:53.454923 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:54.004392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15066): Launched 13:43:54.304182 run osmo-stp_10.42.42.5(pid=15067): Launched 13:43:54.417302 run osmo-msc_10.42.42.6: Starting osmo-msc 13:43:54.952934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15069): Launched 13:43:55.249356 run osmo-msc_10.42.42.6(pid=15070): Launched 13:43:55.415870 run osmo-stp_10.42.42.5(pid=15067): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15067)] 13:43:55.541386 run osmo-stp_10.42.42.5(pid=15067): stdout: | (launched: 2022-12-10_13:43:54.250221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:55.667425 run osmo-stp_10.42.42.5(pid=15067): stderr: | [0;m[38;5;43m20221210134354418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134354418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134354418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134354419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134354419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134354419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134354419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:55.791160 run osmo-stp_10.42.42.5(pid=15067): stdout: | (launched: 2022-12-10_13:43:54.250221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:55.909396 run osmo-stp_10.42.42.5(pid=15067): stderr: | [0;m[38;5;43m20221210134354418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134354418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134354418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134354419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134354419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134354419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134354419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:56.050450 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15067): Process ended prematurely: osmo-stp_10.42.42.5(pid=15067) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15067)] [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:43:56.059228 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:43:56.085397 run osmo-hlr_10.42.42.2(pid=15064): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15064)] 13:43:56.132860 run osmo-hlr_10.42.42.2(pid=15064): stdout: | (launched: 2022-12-10_13:43:53.276509) 13:43:56.181677 run osmo-hlr_10.42.42.2(pid=15064): stderr: | [0;m[1;31m20221210134353471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134353471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134353471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134353471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134353471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134353471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134353483 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134353492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134353492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134353492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:56.249864 run osmo-msc_10.42.42.6(pid=15070): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15070)] 13:43:56.297129 run osmo-msc_10.42.42.6(pid=15070): stdout: | (launched: 2022-12-10_13:43:55.195358) 13:43:56.345607 run osmo-msc_10.42.42.6(pid=15070): stderr: | [0;m[38;5;43m20221210134355465 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134355465 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f38512dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134355465 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134355465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134355466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134355466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134355468 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134355469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134355469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134355469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:43:56.394049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15063): Terminating (SIGTERM) 13:43:56.432847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15066): Terminating (SIGTERM) 13:43:56.471721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15069): Terminating (SIGTERM) 13:43:56.510971 --- ParallelTerminationStrategy: PID 15063 died... 13:43:56.529714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15063): Terminated: ok {rc=0} 13:43:56.573127 --- ParallelTerminationStrategy: PID 15066 died... 13:43:56.591635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15066): Terminated: ok {rc=0} 13:43:56.635119 --- ParallelTerminationStrategy: PID 15069 died... 13:43:56.653590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15069): Terminated: ok {rc=0} 13:43:56.735513 bus /sierra_3: Setting Powered False 13:43:57.833034 bus /sierra_3: Setting Powered False 13:43:58.950989 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:44:00.100766 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:44:00.113063 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:44:00.173617 tst mo_mt_call_osmux.py: using LAC 28800 13:44:00.292874 tst mo_mt_call_osmux.py: using RAC 240 13:44:00.412506 tst mo_mt_call_osmux.py: using CellId 28800 13:44:00.529211 tst mo_mt_call_osmux.py: using BVCI 28801 13:44:00.637631 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:44:00.648719 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:44:00.659716 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:44:00.670861 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:44:00.682018 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:44:00.692821 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:44:00.806187 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:44:00.932832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:01.404408 run create_hlr_db(pid=15072): Launched 13:44:01.557073 bus /sierra_2: Setting Powered False 13:44:02.616250 run create_hlr_db(pid=15072): Terminated: ok {rc=0} 13:44:03.047397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15074): Launched 13:44:03.364157 run osmo-hlr_10.42.42.2(pid=15075): Launched 13:44:03.485772 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:04.033452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15077): Launched 13:44:04.351064 run osmo-stp_10.42.42.5(pid=15078): Launched 13:44:04.471693 run osmo-msc_10.42.42.6: Starting osmo-msc 13:44:05.044738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15080): Launched 13:44:05.362317 run osmo-msc_10.42.42.6(pid=15081): Launched 13:44:05.538663 run osmo-stp_10.42.42.5(pid=15078): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15078)] 13:44:05.673564 run osmo-stp_10.42.42.5(pid=15078): stdout: | (launched: 2022-12-10_13:44:04.293574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:05.808620 run osmo-stp_10.42.42.5(pid=15078): stderr: | [0;m[38;5;43m20221210134404485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134404485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134404485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134404486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134404486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134404486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134404486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:05.942706 run osmo-stp_10.42.42.5(pid=15078): stdout: | (launched: 2022-12-10_13:44:04.293574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:06.069363 run osmo-stp_10.42.42.5(pid=15078): stderr: | [0;m[38;5;43m20221210134404485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134404485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134404485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134404486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134404486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134404486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134404486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:06.220487 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15078): Process ended prematurely: osmo-stp_10.42.42.5(pid=15078) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15078)] [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:44:06.230070 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:44:06.257936 run osmo-hlr_10.42.42.2(pid=15075): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15075)] 13:44:06.307811 run osmo-hlr_10.42.42.2(pid=15075): stdout: | (launched: 2022-12-10_13:44:03.306898) 13:44:06.359392 run osmo-hlr_10.42.42.2(pid=15075): stderr: | [0;m[1;31m20221210134403506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134403506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134403506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134403506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134403506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134403506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134403519 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134403527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134403527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134403527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:06.431371 run osmo-msc_10.42.42.6(pid=15081): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15081)] 13:44:06.481276 run osmo-msc_10.42.42.6(pid=15081): stdout: | (launched: 2022-12-10_13:44:05.304649) 13:44:06.532801 run osmo-msc_10.42.42.6(pid=15081): stderr: | [0;m[38;5;43m20221210134405623 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134405623 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f19424d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134405623 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134405623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134405623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134405623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134405625 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134405626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134405626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134405626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:44:06.584677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15074): Terminating (SIGTERM) 13:44:06.626557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15077): Terminating (SIGTERM) 13:44:06.668266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15080): Terminating (SIGTERM) 13:44:06.710161 --- ParallelTerminationStrategy: PID 15074 died... 13:44:06.729926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15074): Terminated: ok {rc=0} 13:44:06.776086 --- ParallelTerminationStrategy: PID 15077 died... 13:44:06.795207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15077): Terminated: ok {rc=0} 13:44:06.841619 --- ParallelTerminationStrategy: PID 15080 died... 13:44:06.860794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15080): Terminated: ok {rc=0} 13:44:06.948191 bus /sierra_3: Setting Powered False 13:44:08.045508 bus /sierra_3: Setting Powered False 13:44:09.159829 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:44:10.398583 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:44:10.406917 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:44:10.430313 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:44:10.456503 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:44:10.506902 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:44:10.530237 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:44:10.556585 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:44:11.108168 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:44:11.159981 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:44:11.171504 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:44:11.234736 tst mo_mt_call.py: using LAC 28801 13:44:11.358719 tst mo_mt_call.py: using RAC 241 13:44:11.481098 tst mo_mt_call.py: using CellId 28801 13:44:11.604546 tst mo_mt_call.py: using BVCI 28802 13:44:11.719477 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:44:11.730986 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:44:11.742333 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:44:11.753936 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:44:11.765582 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:44:11.777586 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:44:11.894741 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:44:12.011969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:12.501391 run create_hlr_db(pid=15086): Launched 13:44:12.622599 bus /sierra_2: Setting Powered False 13:44:13.685168 run create_hlr_db(pid=15086): Terminated: ok {rc=0} 13:44:14.124507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15088): Launched 13:44:14.439477 run osmo-hlr_10.42.42.2(pid=15089): Launched 13:44:14.560605 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:15.109041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15091): Launched 13:44:15.424745 run osmo-stp_10.42.42.5(pid=15092): Launched 13:44:15.546494 run osmo-msc_10.42.42.6: Starting osmo-msc 13:44:16.134565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15094): Launched 13:44:16.453029 run osmo-msc_10.42.42.6(pid=15095): Launched 13:44:16.910049 run osmo-stp_10.42.42.5(pid=15092): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15092)] 13:44:17.177275 run osmo-stp_10.42.42.5(pid=15092): stdout: | (launched: 2022-12-10_13:44:15.366932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:17.343548 run osmo-stp_10.42.42.5(pid=15092): stderr: | [0;m[38;5;43m20221210134415558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134415559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134415559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134415559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134415560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134415560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134415560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:17.467652 run osmo-stp_10.42.42.5(pid=15092): stdout: | (launched: 2022-12-10_13:44:15.366932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:17.585866 run osmo-stp_10.42.42.5(pid=15092): stderr: | [0;m[38;5;43m20221210134415558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134415559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134415559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134415559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134415560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134415560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134415560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:17.727118 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15092): Process ended prematurely: osmo-stp_10.42.42.5(pid=15092) [trial-2375↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15092)] [trial-2375↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:44:17.736048 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 13:44:17.762416 run osmo-hlr_10.42.42.2(pid=15089): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15089)] 13:44:17.810513 run osmo-hlr_10.42.42.2(pid=15089): stdout: | (launched: 2022-12-10_13:44:14.382269) 13:44:17.859836 run osmo-hlr_10.42.42.2(pid=15089): stderr: | [0;m[1;31m20221210134414580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134414580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134414580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134414580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134414580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134414580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134414592 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134414601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134414601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134414601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:17.928240 run osmo-msc_10.42.42.6(pid=15095): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15095)] 13:44:17.975561 run osmo-msc_10.42.42.6(pid=15095): stdout: | (launched: 2022-12-10_13:44:16.392627) 13:44:18.024435 run osmo-msc_10.42.42.6(pid=15095): stderr: | [0;m[38;5;43m20221210134416839 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134416840 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f191f38ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134416840 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134416840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134416840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134416840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134416844 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134416845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134416845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134416845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:44:18.073564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15088): Terminating (SIGTERM) 13:44:18.113764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15091): Terminating (SIGTERM) 13:44:18.153468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15094): Terminating (SIGTERM) 13:44:18.193075 --- ParallelTerminationStrategy: PID 15088 died... 13:44:18.211910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15088): Terminated: ok {rc=0} 13:44:18.256062 --- ParallelTerminationStrategy: PID 15091 died... 13:44:18.274627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15091): Terminated: ok {rc=0} 13:44:18.317826 --- ParallelTerminationStrategy: PID 15094 died... 13:44:18.336332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15094): Terminated: ok {rc=0} 13:44:18.419906 bus /sierra_3: Setting Powered False 13:44:19.518615 bus /sierra_3: Setting Powered False 13:44:20.632796 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:44:21.776789 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:44:21.788538 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:44:21.847842 tst mo_mt_call_osmux.py: using LAC 28802 13:44:21.968715 tst mo_mt_call_osmux.py: using RAC 242 13:44:22.085880 tst mo_mt_call_osmux.py: using CellId 28802 13:44:22.201146 tst mo_mt_call_osmux.py: using BVCI 28803 13:44:22.308399 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:44:22.319590 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:44:22.330514 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:44:22.341424 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:44:22.352354 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:44:22.363603 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:44:22.477246 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:44:22.590343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:23.049042 run create_hlr_db(pid=15097): Launched 13:44:23.170408 bus /sierra_2: Setting Powered False 13:44:24.230623 run create_hlr_db(pid=15097): Terminated: ok {rc=0} 13:44:24.641624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15099): Launched 13:44:24.936273 run osmo-hlr_10.42.42.2(pid=15100): Launched 13:44:25.049100 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:25.573479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15102): Launched 13:44:25.870872 run osmo-stp_10.42.42.5(pid=15103): Launched 13:44:25.983416 run osmo-msc_10.42.42.6: Starting osmo-msc 13:44:26.519148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15105): Launched 13:44:26.814180 run osmo-msc_10.42.42.6(pid=15106): Launched 13:44:26.979382 run osmo-stp_10.42.42.5(pid=15103): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15103)] 13:44:27.104597 run osmo-stp_10.42.42.5(pid=15103): stdout: | (launched: 2022-12-10_13:44:25.815910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:27.229848 run osmo-stp_10.42.42.5(pid=15103): stderr: | [0;m[38;5;43m20221210134425988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134425988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134425988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134425989 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134425989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134425989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134425989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:27.352828 run osmo-stp_10.42.42.5(pid=15103): stdout: | (launched: 2022-12-10_13:44:25.815910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:27.471070 run osmo-stp_10.42.42.5(pid=15103): stderr: | [0;m[38;5;43m20221210134425988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134425988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134425988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134425989 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134425989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134425989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134425989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:27.611595 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15103): Process ended prematurely: osmo-stp_10.42.42.5(pid=15103) [trial-2375↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15103)] [trial-2375↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:44:27.620141 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 13:44:27.645839 run osmo-hlr_10.42.42.2(pid=15100): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15100)] 13:44:27.692337 run osmo-hlr_10.42.42.2(pid=15100): stdout: | (launched: 2022-12-10_13:44:24.882298) 13:44:27.740676 run osmo-hlr_10.42.42.2(pid=15100): stderr: | [0;m[1;31m20221210134425059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134425059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134425059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134425059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134425059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134425059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134425071 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134425080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134425080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134425080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:27.808107 run osmo-msc_10.42.42.6(pid=15106): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15106)] 13:44:27.854798 run osmo-msc_10.42.42.6(pid=15106): stdout: | (launched: 2022-12-10_13:44:26.760285) 13:44:27.902936 run osmo-msc_10.42.42.6(pid=15106): stderr: | [0;m[38;5;43m20221210134427031 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134427031 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3c35f54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134427031 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134427031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134427031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134427032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134427033 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134427034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134427034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134427034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:44:27.951488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15099): Terminating (SIGTERM) 13:44:27.990054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15102): Terminating (SIGTERM) 13:44:28.028633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15105): Terminating (SIGTERM) 13:44:28.067491 --- ParallelTerminationStrategy: PID 15099 died... 13:44:28.086206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15099): Terminated: ok {rc=0} 13:44:28.129060 --- ParallelTerminationStrategy: PID 15102 died... 13:44:28.147208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15102): Terminated: ok {rc=0} 13:44:28.189947 --- ParallelTerminationStrategy: PID 15105 died... 13:44:28.208113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15105): Terminated: ok {rc=0} 13:44:28.291878 bus /sierra_3: Setting Powered False 13:44:29.388915 bus /sierra_3: Setting Powered False 13:44:30.502182 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 emergency:nanobts+band-1900 --------------------------------------------------------------------- 13:44:31.758571 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:44:31.767540 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:44:31.802717 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 13:44:31.838915 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 13:44:31.943793 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:44:31.985927 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 13:44:32.026404 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 13:44:32.582557 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2375 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 13:44:32.588813 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:44:32.599545 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:44:32.647683 tst emergency_mo_mt_call.py: using LAC 28803 13:44:32.764852 tst emergency_mo_mt_call.py: using RAC 243 13:44:32.880248 tst emergency_mo_mt_call.py: using CellId 28803 13:44:32.995323 tst emergency_mo_mt_call.py: using BVCI 28804 13:44:33.102826 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:44:33.113887 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:44:33.124370 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:44:33.135076 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:44:33.145789 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:44:33.156450 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:44:33.273265 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:44:33.388747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:33.869231 run create_hlr_db(pid=15111): Launched 13:44:33.988542 bus /sierra_2: Setting Powered False 13:44:35.050652 run create_hlr_db(pid=15111): Terminated: ok {rc=0} 13:44:35.483419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15113): Launched 13:44:35.792942 run osmo-hlr_10.42.42.2(pid=15114): Launched 13:44:35.911502 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:36.449482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15116): Launched 13:44:36.760539 run osmo-stp_10.42.42.5(pid=15117): Launched 13:44:36.888822 tst emergency_mo_mt_call.py: using MSISDN 7761 13:44:37.048822 run osmo-msc_10.42.42.6: Starting osmo-msc 13:44:37.608189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15119): Launched 13:44:37.919553 run osmo-msc_10.42.42.6(pid=15120): Launched 13:44:38.094823 run osmo-stp_10.42.42.5(pid=15117): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15117)] 13:44:38.228085 run osmo-stp_10.42.42.5(pid=15117): stdout: | (launched: 2022-12-10_13:44:36.704024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:38.360876 run osmo-stp_10.42.42.5(pid=15117): stderr: | [0;m[38;5;43m20221210134436897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134436897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134436897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134436898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134436898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134436898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134436898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:38.491093 run osmo-stp_10.42.42.5(pid=15117): stdout: | (launched: 2022-12-10_13:44:36.704024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:38.614865 run osmo-stp_10.42.42.5(pid=15117): stderr: | [0;m[38;5;43m20221210134436897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134436897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134436897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134436898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134436898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134436898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134436898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:38.763056 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15117): Process ended prematurely: osmo-stp_10.42.42.5(pid=15117) [trial-2375↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15117)] [trial-2375↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 13:44:38.772049 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 13:44:38.800079 run osmo-hlr_10.42.42.2(pid=15114): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15114)] 13:44:38.850220 run osmo-hlr_10.42.42.2(pid=15114): stdout: | (launched: 2022-12-10_13:44:35.736707) 13:44:38.902401 run osmo-hlr_10.42.42.2(pid=15114): stderr: | [0;m[1;31m20221210134435938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134435938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134435938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134435938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134435938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134435938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134435949 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134435957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134435957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134435957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:38.974351 run osmo-msc_10.42.42.6(pid=15120): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15120)] 13:44:39.024366 run osmo-msc_10.42.42.6(pid=15120): stdout: | (launched: 2022-12-10_13:44:37.862876) 13:44:39.076170 run osmo-msc_10.42.42.6(pid=15120): stderr: | [0;m[38;5;43m20221210134438181 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134438181 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4843013c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134438181 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134438181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134438181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134438182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134438183 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134438184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134438184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134438184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:44:39.128479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15113): Terminating (SIGTERM) 13:44:39.170298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15116): Terminating (SIGTERM) 13:44:39.211985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15119): Terminating (SIGTERM) 13:44:39.254104 --- ParallelTerminationStrategy: PID 15113 died... 13:44:39.274011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15113): Terminated: ok {rc=0} 13:44:39.320539 --- ParallelTerminationStrategy: PID 15116 died... 13:44:39.339995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15116): Terminated: ok {rc=0} 13:44:39.386145 --- ParallelTerminationStrategy: PID 15119 died... 13:44:39.405740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15119): Terminated: ok {rc=0} 13:44:39.492778 bus /sierra_3: Setting Powered False 13:44:40.590314 bus /sierra_3: Setting Powered False 13:44:41.705800 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 13:44:42.790823 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:44:42.802660 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:44:42.844340 tst emergency_preemptive_call.py: using LAC 28804 13:44:42.968940 tst emergency_preemptive_call.py: using RAC 244 13:44:43.091581 tst emergency_preemptive_call.py: using CellId 28804 13:44:43.213945 tst emergency_preemptive_call.py: using BVCI 28805 13:44:43.326987 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:44:43.338054 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:44:43.349018 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:44:43.360208 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:44:43.371342 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:44:43.382469 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:44:43.496418 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:44:43.609697 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:44:43.722511 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:44:43.835118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:44.288058 run create_hlr_db(pid=15122): Launched 13:44:44.409301 bus /sierra_2: Setting Powered False 13:44:45.468513 run create_hlr_db(pid=15122): Terminated: ok {rc=0} 13:44:45.874523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15124): Launched 13:44:46.252138 run osmo-hlr_10.42.42.2(pid=15125): Launched 13:44:46.401341 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:47.140678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15127): Launched 13:44:47.475300 run osmo-stp_10.42.42.5(pid=15128): Launched 13:44:47.628246 tst emergency_preemptive_call.py: using MSISDN 7762 13:44:47.800752 run osmo-msc_10.42.42.6: Starting osmo-msc 13:44:48.330204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15130): Launched 13:44:48.620441 run osmo-msc_10.42.42.6(pid=15131): Launched 13:44:48.782516 run osmo-stp_10.42.42.5(pid=15128): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15128)] 13:44:48.906236 run osmo-stp_10.42.42.5(pid=15128): stdout: | (launched: 2022-12-10_13:44:47.413942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:49.031168 run osmo-stp_10.42.42.5(pid=15128): stderr: | [0;m[38;5;43m20221210134447707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134447707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134447708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134447708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134447708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134447709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134447709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:49.152897 run osmo-stp_10.42.42.5(pid=15128): stdout: | (launched: 2022-12-10_13:44:47.413942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:49.269232 run osmo-stp_10.42.42.5(pid=15128): stderr: | [0;m[38;5;43m20221210134447707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134447707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134447708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134447708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134447708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134447709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134447709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:49.407934 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15128): Process ended prematurely: osmo-stp_10.42.42.5(pid=15128) [trial-2375↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15128)] [trial-2375↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 13:44:49.416056 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 13:44:49.441619 run osmo-hlr_10.42.42.2(pid=15125): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15125)] 13:44:49.488436 run osmo-hlr_10.42.42.2(pid=15125): stdout: | (launched: 2022-12-10_13:44:46.173245) 13:44:49.537096 run osmo-hlr_10.42.42.2(pid=15125): stderr: | [0;m[1;31m20221210134446642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134446642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134446642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134446644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134446645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134446646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134446666 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134446687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134446687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134446687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:49.605541 run osmo-msc_10.42.42.6(pid=15131): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15131)] 13:44:49.652354 run osmo-msc_10.42.42.6(pid=15131): stdout: | (launched: 2022-12-10_13:44:48.566964) 13:44:49.700480 run osmo-msc_10.42.42.6(pid=15131): stderr: | [0;m[38;5;43m20221210134448837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134448837 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5142924c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134448837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134448837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134448837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134448838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134448839 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134448840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134448840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134448840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:44:49.749242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15124): Terminating (SIGTERM) 13:44:49.787872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15127): Terminating (SIGTERM) 13:44:49.826825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15130): Terminating (SIGTERM) 13:44:49.865866 --- ParallelTerminationStrategy: PID 15124 died... 13:44:49.884299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15124): Terminated: ok {rc=0} 13:44:49.927471 --- ParallelTerminationStrategy: PID 15127 died... 13:44:49.945864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15127): Terminated: ok {rc=0} 13:44:49.988705 --- ParallelTerminationStrategy: PID 15130 died... 13:44:50.006932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15130): Terminated: ok {rc=0} 13:44:50.091665 bus /sierra_9: Setting Powered False 13:44:51.191150 bus /sierra_9: Setting Powered False 13:44:52.305166 bus /sierra_8: Setting Powered False 13:44:53.403909 bus /sierra_8: Setting Powered False 13:44:54.517784 bus /sierra_3: Setting Powered False 13:44:55.614983 bus /sierra_3: Setting Powered False 13:44:56.729467 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-1900 --------------------------------------------------------------------- 13:44:57.998254 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:44:58.004393 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:44:58.028433 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 13:44:58.065684 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 13:44:58.149946 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:44:58.172931 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 13:44:58.210308 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 13:44:58.803488 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 13:44:58.856366 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:44:58.867561 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:44:58.911342 tst cs_paging_gprs_active.py: using LAC 28805 13:44:59.035236 tst cs_paging_gprs_active.py: using RAC 245 13:44:59.158909 tst cs_paging_gprs_active.py: using CellId 28805 13:44:59.284490 tst cs_paging_gprs_active.py: using BVCI 28806 13:44:59.393218 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:44:59.403632 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:44:59.413965 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:44:59.424466 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:44:59.434670 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:44:59.444753 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:44:59.455154 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:44:59.465473 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:44:59.475824 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:44:59.592598 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:44:59.712401 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:44:59.926345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:00.244313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15136): Launched 13:45:00.520052 run iperf3-srv_10.42.42.10(pid=15137): Launched 13:45:00.639204 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:45:00.875093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:01.226971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15138): Launched 13:45:01.517878 run iperf3-srv_10.42.42.10(pid=15139): Launched 13:45:01.652596 tst cs_paging_gprs_active.py:38: start network... 13:45:01.898559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:02.397423 run create_hlr_db(pid=15143): Launched 13:45:02.519431 bus /sierra_2: Setting Powered False 13:45:03.582722 run create_hlr_db(pid=15143): Terminated: ok {rc=0} 13:45:04.004940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15145): Launched 13:45:04.301620 run osmo-hlr_10.42.42.2(pid=15146): Launched 13:45:04.415198 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:04.927679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15148): Launched 13:45:05.225176 run osmo-stp_10.42.42.5(pid=15149): Launched 13:45:05.338718 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:05.852745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15151): Launched 13:45:05.966279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:06.217870 run patchelf(pid=15152): Launched 13:45:06.382955 run osmo-stp_10.42.42.5(pid=15149): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15149)] 13:45:06.508657 run osmo-stp_10.42.42.5(pid=15149): stdout: | (launched: 2022-12-10_13:45:05.170557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:06.637217 run osmo-stp_10.42.42.5(pid=15149): stderr: | [0;m[38;5;43m20221210134505342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134505343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134505343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134505344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134505344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134505344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134505344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:06.764527 run osmo-stp_10.42.42.5(pid=15149): stdout: | (launched: 2022-12-10_13:45:05.170557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:06.886868 run osmo-stp_10.42.42.5(pid=15149): stderr: | [0;m[38;5;43m20221210134505342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134505343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134505343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134505344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134505344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134505344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134505344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:07.031569 run patchelf(pid=15152): Terminating (SIGINT) 13:45:07.199069 run patchelf(pid=15152): Terminated: ok {rc=0} 13:45:07.319800 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15149): Process ended prematurely: osmo-stp_10.42.42.5(pid=15149) [trial-2375↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15149)] [trial-2375↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 13:45:07.329334 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:45:07.356132 run osmo-hlr_10.42.42.2(pid=15146): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15146)] 13:45:07.402879 run osmo-hlr_10.42.42.2(pid=15146): stdout: | (launched: 2022-12-10_13:45:04.247419) 13:45:07.451511 run osmo-hlr_10.42.42.2(pid=15146): stderr: | [0;m[1;31m20221210134504423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134504423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134504423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134504423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134504423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134504423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134504435 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134504444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134504444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134504444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:07.500556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15136): Terminating (SIGTERM) 13:45:07.539780 run iperf3-srv_10.42.42.10(pid=15137): Terminating (SIGTERM) 13:45:07.580403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15138): Terminating (SIGTERM) 13:45:07.619867 run iperf3-srv_10.42.42.10(pid=15139): Terminating (SIGTERM) 13:45:07.659271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15145): Terminating (SIGTERM) 13:45:07.698536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15148): Terminating (SIGTERM) 13:45:07.738090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15151): Terminating (SIGTERM) 13:45:07.777219 --- ParallelTerminationStrategy: PID 15136 died... 13:45:07.795831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15136): Terminated: ok {rc=0} 13:45:07.839328 --- ParallelTerminationStrategy: PID 15137 died... 13:45:07.857650 run iperf3-srv_10.42.42.10(pid=15137): Terminated {rc=256} 13:45:07.900519 --- ParallelTerminationStrategy: PID 15138 died... 13:45:07.918925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15138): Terminated: ok {rc=0} 13:45:07.961915 --- ParallelTerminationStrategy: PID 15139 died... 13:45:07.980020 run iperf3-srv_10.42.42.10(pid=15139): Terminated {rc=256} 13:45:08.022861 --- ParallelTerminationStrategy: PID 15145 died... 13:45:08.041176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15145): Terminated: ok {rc=0} 13:45:08.084172 --- ParallelTerminationStrategy: PID 15148 died... 13:45:08.102596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15148): Terminated: ok {rc=0} 13:45:08.146488 --- ParallelTerminationStrategy: PID 15151 died... 13:45:08.165123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15151): Terminated: ok {rc=0} 13:45:08.250228 bus /gobi_0: Setting Powered False 13:45:09.348596 bus /gobi_0: Setting Powered False 13:45:10.462884 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 13:45:11.612316 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:11.623706 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:45:11.662904 tst iperf3.py: using LAC 28806 13:45:11.788393 tst iperf3.py: using RAC 246 13:45:11.914345 tst iperf3.py: using CellId 28806 13:45:12.032498 tst iperf3.py: using BVCI 28807 13:45:12.141827 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:12.152468 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:12.163085 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:12.174261 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:12.185432 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:12.196358 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:12.207507 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:12.218639 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:12.229809 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:45:12.347955 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:45:12.562588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:12.880266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15153): Launched 13:45:13.156409 run iperf3-srv_10.42.42.10(pid=15154): Launched 13:45:13.275265 tst iperf3.py:8: start network... 13:45:13.489602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:13.982740 run create_hlr_db(pid=15155): Launched 13:45:14.104398 bus /gobi_6: Setting Powered False 13:45:15.167683 run create_hlr_db(pid=15155): Terminated: ok {rc=0} 13:45:15.591540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15157): Launched 13:45:15.914499 run osmo-hlr_10.42.42.2(pid=15158): Launched 13:45:16.136702 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:16.781769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15160): Launched 13:45:17.118495 run osmo-stp_10.42.42.5(pid=15161): Launched 13:45:17.302194 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:17.815578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15163): Launched 13:45:17.928684 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:18.180098 run patchelf(pid=15164): Launched 13:45:18.344802 run osmo-stp_10.42.42.5(pid=15161): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15161)] 13:45:18.470754 run osmo-stp_10.42.42.5(pid=15161): stdout: | (launched: 2022-12-10_13:45:17.051892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:18.598245 run osmo-stp_10.42.42.5(pid=15161): stderr: | [0;m[38;5;43m20221210134517291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134517291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134517292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134517292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134517293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134517293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134517293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:18.725902 run osmo-stp_10.42.42.5(pid=15161): stdout: | (launched: 2022-12-10_13:45:17.051892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:18.848161 run osmo-stp_10.42.42.5(pid=15161): stderr: | [0;m[38;5;43m20221210134517291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134517291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134517292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134517292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134517293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134517293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134517293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:18.992380 run patchelf(pid=15164): Terminating (SIGINT) 13:45:19.160090 run patchelf(pid=15164): Terminated: ok {rc=0} 13:45:19.280862 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15161): Process ended prematurely: osmo-stp_10.42.42.5(pid=15161) [trial-2375↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15161)] [trial-2375↪gprs:nanobts+band-1900↪iperf3.py:8] 13:45:19.290475 tst iperf3.py:8: Test FAILED (7.7 sec) 13:45:19.317580 run osmo-hlr_10.42.42.2(pid=15158): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15158)] 13:45:19.365047 run osmo-hlr_10.42.42.2(pid=15158): stdout: | (launched: 2022-12-10_13:45:15.838253) 13:45:19.413662 run osmo-hlr_10.42.42.2(pid=15158): stderr: | [0;m[1;31m20221210134516076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134516076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134516076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134516076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134516078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134516078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134516093 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134516107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134516107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134516108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:19.463109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15153): Terminating (SIGTERM) 13:45:19.502574 run iperf3-srv_10.42.42.10(pid=15154): Terminating (SIGTERM) 13:45:19.541666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15157): Terminating (SIGTERM) 13:45:19.580795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15160): Terminating (SIGTERM) 13:45:19.619794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15163): Terminating (SIGTERM) 13:45:19.659271 --- ParallelTerminationStrategy: PID 15153 died... 13:45:19.677966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15153): Terminated: ok {rc=0} 13:45:19.721201 --- ParallelTerminationStrategy: PID 15154 died... 13:45:19.739368 run iperf3-srv_10.42.42.10(pid=15154): Terminated {rc=256} 13:45:19.782283 --- ParallelTerminationStrategy: PID 15157 died... 13:45:19.801043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15157): Terminated: ok {rc=0} 13:45:19.844527 --- ParallelTerminationStrategy: PID 15160 died... 13:45:19.862938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15160): Terminated: ok {rc=0} 13:45:19.905915 --- ParallelTerminationStrategy: PID 15163 died... 13:45:19.924066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15163): Terminated: ok {rc=0} 13:45:20.007817 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 13:45:21.152549 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:21.163663 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:45:21.202486 tst iperf3m4.py: using LAC 28807 13:45:21.321199 tst iperf3m4.py: using RAC 247 13:45:21.437613 tst iperf3m4.py: using CellId 28807 13:45:21.554402 tst iperf3m4.py: using BVCI 28808 13:45:21.662533 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:21.673400 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:21.683791 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:21.694767 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:21.705566 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:21.716297 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:21.727191 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:21.738100 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:21.749062 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:45:21.870203 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:45:21.992599 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:45:22.112132 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:45:22.231232 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:45:22.445666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:22.765585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15165): Launched 13:45:23.041658 run iperf3-srv_10.42.42.10(pid=15166): Launched 13:45:23.161511 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:45:23.376099 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:23.695181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15167): Launched 13:45:23.971173 run iperf3-srv_10.42.42.10(pid=15168): Launched 13:45:24.090020 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:45:24.304003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:24.621601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15169): Launched 13:45:24.896874 run iperf3-srv_10.42.42.10(pid=15170): Launched 13:45:25.015669 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:45:25.229714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:25.547599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15171): Launched 13:45:25.823041 run iperf3-srv_10.42.42.10(pid=15172): Launched 13:45:25.941509 tst iperf3m4.py:8: start network... 13:45:26.155556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:26.646995 run create_hlr_db(pid=15173): Launched 13:45:26.767833 bus /gobi_6: Setting Powered False 13:45:27.830375 run create_hlr_db(pid=15173): Terminated: ok {rc=0} 13:45:28.252915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15175): Launched 13:45:28.548740 run osmo-hlr_10.42.42.2(pid=15176): Launched 13:45:28.662952 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:29.173929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15178): Launched 13:45:29.469409 run osmo-stp_10.42.42.5(pid=15179): Launched 13:45:29.583445 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:30.098271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15181): Launched 13:45:30.212169 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:30.463431 run patchelf(pid=15182): Launched 13:45:30.630522 run osmo-stp_10.42.42.5(pid=15179): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15179)] 13:45:30.756815 run osmo-stp_10.42.42.5(pid=15179): stdout: | (launched: 2022-12-10_13:45:29.415357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:30.902983 run osmo-stp_10.42.42.5(pid=15179): stderr: | [0;m[38;5;43m20221210134529585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134529585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134529585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134529586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134529586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134529586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134529586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:31.034874 run osmo-stp_10.42.42.5(pid=15179): stdout: | (launched: 2022-12-10_13:45:29.415357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:31.160261 run osmo-stp_10.42.42.5(pid=15179): stderr: | [0;m[38;5;43m20221210134529585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134529585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134529585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134529586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134529586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134529586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134529586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:31.308401 run patchelf(pid=15182): Terminating (SIGINT) 13:45:31.479562 run patchelf(pid=15182): Terminated: ok {rc=0} 13:45:31.602839 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15179): Process ended prematurely: osmo-stp_10.42.42.5(pid=15179) [trial-2375↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15179)] [trial-2375↪gprs:nanobts+band-1900↪iperf3m4.py:8] 13:45:31.612808 tst iperf3m4.py:8: Test FAILED (10.5 sec) 13:45:31.640644 run osmo-hlr_10.42.42.2(pid=15176): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15176)] 13:45:31.688554 run osmo-hlr_10.42.42.2(pid=15176): stdout: | (launched: 2022-12-10_13:45:28.494488) 13:45:31.738300 run osmo-hlr_10.42.42.2(pid=15176): stderr: | [0;m[1;31m20221210134528670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134528670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134528670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134528670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134528670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134528670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134528683 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134528692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134528692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134528692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:31.788252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15165): Terminating (SIGTERM) 13:45:31.828778 run iperf3-srv_10.42.42.10(pid=15166): Terminating (SIGTERM) 13:45:31.872142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15167): Terminating (SIGTERM) 13:45:31.913357 run iperf3-srv_10.42.42.10(pid=15168): Terminating (SIGTERM) 13:45:31.956520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15169): Terminating (SIGTERM) 13:45:31.997518 run iperf3-srv_10.42.42.10(pid=15170): Terminating (SIGTERM) 13:45:32.040684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15171): Terminating (SIGTERM) 13:45:32.081676 run iperf3-srv_10.42.42.10(pid=15172): Terminating (SIGTERM) 13:45:32.123438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15175): Terminating (SIGTERM) 13:45:32.165517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15178): Terminating (SIGTERM) 13:45:32.208349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15181): Terminating (SIGTERM) 13:45:32.248751 --- ParallelTerminationStrategy: PID 15165 died... 13:45:32.267569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15165): Terminated: ok {rc=0} 13:45:32.310876 --- ParallelTerminationStrategy: PID 15166 died... 13:45:32.329060 run iperf3-srv_10.42.42.10(pid=15166): Terminated {rc=256} 13:45:32.371763 --- ParallelTerminationStrategy: PID 15167 died... 13:45:32.390037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15167): Terminated: ok {rc=0} 13:45:32.432840 --- ParallelTerminationStrategy: PID 15168 died... 13:45:32.451390 run iperf3-srv_10.42.42.10(pid=15168): Terminated {rc=256} 13:45:32.494103 --- ParallelTerminationStrategy: PID 15169 died... 13:45:32.512283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15169): Terminated: ok {rc=0} 13:45:32.555564 --- ParallelTerminationStrategy: PID 15170 died... 13:45:32.573699 run iperf3-srv_10.42.42.10(pid=15170): Terminated {rc=256} 13:45:32.616490 --- ParallelTerminationStrategy: PID 15171 died... 13:45:32.634802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15171): Terminated: ok {rc=0} 13:45:32.677752 --- ParallelTerminationStrategy: PID 15172 died... 13:45:32.695958 run iperf3-srv_10.42.42.10(pid=15172): Terminated {rc=256} 13:45:32.739102 --- ParallelTerminationStrategy: PID 15175 died... 13:45:32.757265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15175): Terminated: ok {rc=0} 13:45:32.800262 --- ParallelTerminationStrategy: PID 15178 died... 13:45:32.818516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15178): Terminated: ok {rc=0} 13:45:32.861370 --- ParallelTerminationStrategy: PID 15181 died... 13:45:32.879359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15181): Terminated: ok {rc=0} 13:45:32.963151 bus /gobi_4: Setting Powered False 13:45:34.061164 bus /gobi_4: Setting Powered False 13:45:35.174071 bus /gobi_1: Setting Powered False 13:45:36.272372 bus /gobi_1: Setting Powered False 13:45:37.383981 bus /gobi_0: Setting Powered False 13:45:38.482963 bus /gobi_0: Setting Powered False 13:45:39.596127 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 13:45:40.698680 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:40.710449 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:45:40.750295 tst ping.py: using LAC 28808 13:45:40.873872 tst ping.py: using RAC 248 13:45:40.998815 tst ping.py: using CellId 28808 13:45:41.121587 tst ping.py: using BVCI 28809 13:45:41.236251 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:41.247343 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:41.258513 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:41.270122 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:41.281424 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:41.292592 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:41.303978 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:41.315369 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:45:41.431840 tst ping.py:19: start network... 13:45:41.641270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:42.120862 run create_hlr_db(pid=15183): Launched 13:45:42.239219 bus /gobi_6: Setting Powered False 13:45:43.300760 run create_hlr_db(pid=15183): Terminated: ok {rc=0} 13:45:43.716365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15185): Launched 13:45:44.006665 run osmo-hlr_10.42.42.2(pid=15186): Launched 13:45:44.117954 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:44.653330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15188): Launched 13:45:44.964004 run osmo-stp_10.42.42.5(pid=15189): Launched 13:45:45.082161 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:45.621738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15191): Launched 13:45:45.741134 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:46.040238 run patchelf(pid=15192): Launched 13:45:46.218161 run osmo-stp_10.42.42.5(pid=15189): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15189)] 13:45:46.349274 run osmo-stp_10.42.42.5(pid=15189): stdout: | (launched: 2022-12-10_13:45:44.907341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:46.478306 run osmo-stp_10.42.42.5(pid=15189): stderr: | [0;m[38;5;43m20221210134545097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134545097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134545097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134545098 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134545100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134545100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134545100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:46.607869 run osmo-stp_10.42.42.5(pid=15189): stdout: | (launched: 2022-12-10_13:45:44.907341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:46.731776 run osmo-stp_10.42.42.5(pid=15189): stderr: | [0;m[38;5;43m20221210134545097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134545097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134545097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134545098 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134545100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134545100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134545100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:46.877228 run patchelf(pid=15192): Terminating (SIGINT) 13:45:47.046778 run patchelf(pid=15192): Terminated: ok {rc=0} 13:45:47.169155 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15189): Process ended prematurely: osmo-stp_10.42.42.5(pid=15189) [trial-2375↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15189)] [trial-2375↪gprs:nanobts+band-1900↪ping.py:22] 13:45:47.178392 tst ping.py:22: Test FAILED (6.5 sec) 13:45:47.205624 run osmo-hlr_10.42.42.2(pid=15186): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15186)] 13:45:47.253518 run osmo-hlr_10.42.42.2(pid=15186): stdout: | (launched: 2022-12-10_13:45:43.952871) 13:45:47.302005 run osmo-hlr_10.42.42.2(pid=15186): stderr: | [0;m[1;31m20221210134544127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134544127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134544127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134544127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134544127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134544127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134544140 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134544148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134544148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134544149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:47.351837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15185): Terminating (SIGTERM) 13:45:47.391103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15188): Terminating (SIGTERM) 13:45:47.430250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15191): Terminating (SIGTERM) 13:45:47.469826 --- ParallelTerminationStrategy: PID 15185 died... 13:45:47.488618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15185): Terminated: ok {rc=0} 13:45:47.532150 --- ParallelTerminationStrategy: PID 15188 died... 13:45:47.550764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15188): Terminated: ok {rc=0} 13:45:47.594304 --- ParallelTerminationStrategy: PID 15191 died... 13:45:47.612706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15191): Terminated: ok {rc=0} 13:45:47.694869 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 13:45:48.780626 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:48.792774 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:45:48.833869 tst ping_idle_ping.py: using LAC 28809 13:45:48.958316 tst ping_idle_ping.py: using RAC 249 13:45:49.080789 tst ping_idle_ping.py: using CellId 28809 13:45:49.207830 tst ping_idle_ping.py: using BVCI 28810 13:45:49.315968 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:49.326700 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:49.337119 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:49.347708 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:49.357978 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:49.368377 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:49.379263 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:45:49.389648 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:45:49.502018 tst ping_idle_ping.py:24: start network... 13:45:49.696752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:50.153296 run create_hlr_db(pid=15193): Launched 13:45:50.273078 bus /gobi_6: Setting Powered False 13:45:51.331679 run create_hlr_db(pid=15193): Terminated: ok {rc=0} 13:45:51.739184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15195): Launched 13:45:52.030974 run osmo-hlr_10.42.42.2(pid=15196): Launched 13:45:52.143420 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:52.645894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15198): Launched 13:45:52.940440 run osmo-stp_10.42.42.5(pid=15199): Launched 13:45:53.052118 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:53.557131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15201): Launched 13:45:53.668405 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:53.915213 run patchelf(pid=15202): Launched 13:45:54.078734 run osmo-stp_10.42.42.5(pid=15199): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15199)] 13:45:54.203579 run osmo-stp_10.42.42.5(pid=15199): stdout: | (launched: 2022-12-10_13:45:52.886147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:54.329731 run osmo-stp_10.42.42.5(pid=15199): stderr: | [0;m[38;5;43m20221210134553055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134553055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134553055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134553055 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134553056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134553056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134553056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:54.456009 run osmo-stp_10.42.42.5(pid=15199): stdout: | (launched: 2022-12-10_13:45:52.886147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:54.576638 run osmo-stp_10.42.42.5(pid=15199): stderr: | [0;m[38;5;43m20221210134553055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134553055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134553055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134553055 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134553056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134553056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134553056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:54.719739 run patchelf(pid=15202): Terminating (SIGINT) 13:45:54.885354 run patchelf(pid=15202): Terminated: ok {rc=0} 13:45:55.004214 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15199): Process ended prematurely: osmo-stp_10.42.42.5(pid=15199) [trial-2375↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15199)] [trial-2375↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 13:45:55.013286 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 13:45:55.039736 run osmo-hlr_10.42.42.2(pid=15196): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15196)] 13:45:55.086708 run osmo-hlr_10.42.42.2(pid=15196): stdout: | (launched: 2022-12-10_13:45:51.977509) 13:45:55.135319 run osmo-hlr_10.42.42.2(pid=15196): stderr: | [0;m[1;31m20221210134552154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134552154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134552154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134552154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134552155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134552155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134552167 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134552175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134552175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134552176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:55.184030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15195): Terminating (SIGTERM) 13:45:55.223259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15198): Terminating (SIGTERM) 13:45:55.262400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15201): Terminating (SIGTERM) 13:45:55.301751 --- ParallelTerminationStrategy: PID 15195 died... 13:45:55.320605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15195): Terminated: ok {rc=0} 13:45:55.364008 --- ParallelTerminationStrategy: PID 15198 died... 13:45:55.382615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15198): Terminated: ok {rc=0} 13:45:55.425943 --- ParallelTerminationStrategy: PID 15201 died... 13:45:55.444206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15201): Terminated: ok {rc=0} 13:45:55.529974 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 13:45:56.819682 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:45:56.825966 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:45:56.849605 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:45:56.886913 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:45:56.971060 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:45:56.993974 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:45:57.031248 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:45:57.626497 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:45:57.673748 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:45:57.684394 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:45:57.723816 tst cs_paging_gprs_active.py: using LAC 28810 13:45:57.842508 tst cs_paging_gprs_active.py: using RAC 250 13:45:57.959348 tst cs_paging_gprs_active.py: using CellId 28810 13:45:58.073691 tst cs_paging_gprs_active.py: using BVCI 28811 13:45:58.181636 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:45:58.192306 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:45:58.202872 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:45:58.213577 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:45:58.223940 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:45:58.234407 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:45:58.245063 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:45:58.255443 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:45:58.266112 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:45:58.382765 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:45:58.502507 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:45:58.701109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:58.997881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15206): Launched 13:45:59.254994 run iperf3-srv_10.42.42.10(pid=15207): Launched 13:45:59.365854 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:45:59.563843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:59.860400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15208): Launched 13:46:00.118970 run iperf3-srv_10.42.42.10(pid=15209): Launched 13:46:00.230322 tst cs_paging_gprs_active.py:38: start network... 13:46:00.428037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:00.908061 run create_hlr_db(pid=15210): Launched 13:46:01.071442 bus /gobi_6: Setting Powered False 13:46:02.131087 run create_hlr_db(pid=15210): Terminated: ok {rc=0} 13:46:02.550350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15212): Launched 13:46:02.846145 run osmo-hlr_10.42.42.2(pid=15213): Launched 13:46:02.959143 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:03.482910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15215): Launched 13:46:03.780058 run osmo-stp_10.42.42.5(pid=15216): Launched 13:46:03.893922 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:46:04.407198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15218): Launched 13:46:04.520022 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:46:04.770506 run patchelf(pid=15219): Launched 13:46:04.935219 run osmo-stp_10.42.42.5(pid=15216): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15216)] 13:46:05.060817 run osmo-stp_10.42.42.5(pid=15216): stdout: | (launched: 2022-12-10_13:46:03.725932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:05.188173 run osmo-stp_10.42.42.5(pid=15216): stderr: | [0;m[38;5;43m20221210134603893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134603893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134603894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134603894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134603896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134603896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134603896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:05.315338 run osmo-stp_10.42.42.5(pid=15216): stdout: | (launched: 2022-12-10_13:46:03.725932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:05.437448 run osmo-stp_10.42.42.5(pid=15216): stderr: | [0;m[38;5;43m20221210134603893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134603893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134603894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134603894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134603896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134603896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134603896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:05.581769 run patchelf(pid=15219): Terminating (SIGINT) 13:46:05.748856 run patchelf(pid=15219): Terminated: ok {rc=0} 13:46:05.869476 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15216): Process ended prematurely: osmo-stp_10.42.42.5(pid=15216) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15216)] [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:46:05.879244 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 13:46:05.906026 run osmo-hlr_10.42.42.2(pid=15213): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15213)] 13:46:05.953063 run osmo-hlr_10.42.42.2(pid=15213): stdout: | (launched: 2022-12-10_13:46:02.792013) 13:46:06.001566 run osmo-hlr_10.42.42.2(pid=15213): stderr: | [0;m[1;31m20221210134602970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134602970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134602970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134602970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134602970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134602970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134602980 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134602990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134602990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134602990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:06.050660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15206): Terminating (SIGTERM) 13:46:06.090017 run iperf3-srv_10.42.42.10(pid=15207): Terminating (SIGTERM) 13:46:06.129397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15208): Terminating (SIGTERM) 13:46:06.169122 run iperf3-srv_10.42.42.10(pid=15209): Terminating (SIGTERM) 13:46:06.208344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15212): Terminating (SIGTERM) 13:46:06.247540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15215): Terminating (SIGTERM) 13:46:06.286897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15218): Terminating (SIGTERM) 13:46:06.326275 --- ParallelTerminationStrategy: PID 15206 died... 13:46:06.344872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15206): Terminated: ok {rc=0} 13:46:06.389197 --- ParallelTerminationStrategy: PID 15207 died... 13:46:06.407515 run iperf3-srv_10.42.42.10(pid=15207): Terminated {rc=256} 13:46:06.450500 --- ParallelTerminationStrategy: PID 15208 died... 13:46:06.469007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15208): Terminated: ok {rc=0} 13:46:06.512588 --- ParallelTerminationStrategy: PID 15209 died... 13:46:06.530919 run iperf3-srv_10.42.42.10(pid=15209): Terminated {rc=256} 13:46:06.574127 --- ParallelTerminationStrategy: PID 15212 died... 13:46:06.592362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15212): Terminated: ok {rc=0} 13:46:06.636530 --- ParallelTerminationStrategy: PID 15215 died... 13:46:06.655003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15215): Terminated: ok {rc=0} 13:46:06.698132 --- ParallelTerminationStrategy: PID 15218 died... 13:46:06.716577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15218): Terminated: ok {rc=0} 13:46:06.801241 bus /gobi_0: Setting Powered False 13:46:07.899971 bus /gobi_0: Setting Powered False 13:46:09.014591 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:46:10.158789 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:10.170257 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:46:10.212339 tst iperf3.py: using LAC 28811 13:46:10.330536 tst iperf3.py: using RAC 251 13:46:10.447372 tst iperf3.py: using CellId 28811 13:46:10.565311 tst iperf3.py: using BVCI 28812 13:46:10.672929 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:10.683764 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:10.694300 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:10.704761 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:10.715198 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:10.725718 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:10.736343 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:10.746750 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:10.757406 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:46:10.870629 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:46:11.069937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:46:11.367645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15220): Launched 13:46:11.625098 run iperf3-srv_10.42.42.10(pid=15221): Launched 13:46:11.735876 tst iperf3.py:8: start network... 13:46:11.934375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:12.394010 run create_hlr_db(pid=15222): Launched 13:46:12.514783 bus /gobi_6: Setting Powered False 13:46:13.573886 run create_hlr_db(pid=15222): Terminated: ok {rc=0} 13:46:13.986352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15224): Launched 13:46:14.282785 run osmo-hlr_10.42.42.2(pid=15225): Launched 13:46:14.395483 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:14.906237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15227): Launched 13:46:15.201960 run osmo-stp_10.42.42.5(pid=15228): Launched 13:46:15.314941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:46:15.825622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15230): Launched 13:46:15.963463 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:46:16.252592 run patchelf(pid=15231): Launched 13:46:16.443008 run osmo-stp_10.42.42.5(pid=15228): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15228)] 13:46:16.584110 run osmo-stp_10.42.42.5(pid=15228): stdout: | (launched: 2022-12-10_13:46:15.147542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:16.725960 run osmo-stp_10.42.42.5(pid=15228): stderr: | [0;m[38;5;43m20221210134615319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134615319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134615319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134615319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134615320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134615320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134615320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:16.867862 run osmo-stp_10.42.42.5(pid=15228): stdout: | (launched: 2022-12-10_13:46:15.147542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:17.003856 run osmo-stp_10.42.42.5(pid=15228): stderr: | [0;m[38;5;43m20221210134615319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134615319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134615319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134615319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134615320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134615320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134615320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:17.165554 run patchelf(pid=15231): Terminating (SIGINT) 13:46:17.346035 run patchelf(pid=15231): Terminated: ok {rc=0} 13:46:17.476217 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15228): Process ended prematurely: osmo-stp_10.42.42.5(pid=15228) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15228)] [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 13:46:17.486724 tst iperf3.py:8: Test FAILED (7.4 sec) 13:46:17.516152 run osmo-hlr_10.42.42.2(pid=15225): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15225)] 13:46:17.566584 run osmo-hlr_10.42.42.2(pid=15225): stdout: | (launched: 2022-12-10_13:46:14.228293) 13:46:17.618850 run osmo-hlr_10.42.42.2(pid=15225): stderr: | [0;m[1;31m20221210134614406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134614406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134614406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134614406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134614406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134614406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134614458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134614468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134614468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134614468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:17.671371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15220): Terminating (SIGTERM) 13:46:17.713435 run iperf3-srv_10.42.42.10(pid=15221): Terminating (SIGTERM) 13:46:17.755578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15224): Terminating (SIGTERM) 13:46:17.797942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15227): Terminating (SIGTERM) 13:46:17.839811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15230): Terminating (SIGTERM) 13:46:17.882297 --- ParallelTerminationStrategy: PID 15220 died... 13:46:17.902245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15220): Terminated: ok {rc=0} 13:46:17.949029 --- ParallelTerminationStrategy: PID 15221 died... 13:46:17.968654 run iperf3-srv_10.42.42.10(pid=15221): Terminated {rc=256} 13:46:18.015145 --- ParallelTerminationStrategy: PID 15224 died... 13:46:18.034753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15224): Terminated: ok {rc=0} 13:46:18.081513 --- ParallelTerminationStrategy: PID 15227 died... 13:46:18.101183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15227): Terminated: ok {rc=0} 13:46:18.148282 --- ParallelTerminationStrategy: PID 15230 died... 13:46:18.167815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15230): Terminated: ok {rc=0} 13:46:18.255654 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:46:19.404084 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:19.415953 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:46:19.458557 tst iperf3m4.py: using LAC 28812 13:46:19.584724 tst iperf3m4.py: using RAC 252 13:46:19.710257 tst iperf3m4.py: using CellId 28812 13:46:19.837828 tst iperf3m4.py: using BVCI 28813 13:46:19.954450 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:19.965908 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:19.976800 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:19.988245 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:19.999662 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:20.011069 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:20.022898 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:20.034469 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:20.046183 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:46:20.163838 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:46:20.283178 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:46:20.401226 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:46:20.519265 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:46:20.718703 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:46:21.016757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15232): Launched 13:46:21.275352 run iperf3-srv_10.42.42.10(pid=15233): Launched 13:46:21.386772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:46:21.585393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:46:21.883054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15234): Launched 13:46:22.140854 run iperf3-srv_10.42.42.10(pid=15235): Launched 13:46:22.251846 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:46:22.451441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:46:22.749442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15236): Launched 13:46:23.009214 run iperf3-srv_10.42.42.10(pid=15237): Launched 13:46:23.120548 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:46:23.319746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:46:23.618291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15238): Launched 13:46:23.875441 run iperf3-srv_10.42.42.10(pid=15239): Launched 13:46:23.986425 tst iperf3m4.py:8: start network... 13:46:24.184768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:24.646797 run create_hlr_db(pid=15240): Launched 13:46:24.768871 bus /gobi_6: Setting Powered False 13:46:25.828542 run create_hlr_db(pid=15240): Terminated: ok {rc=0} 13:46:26.262944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15242): Launched 13:46:26.581556 run osmo-hlr_10.42.42.2(pid=15243): Launched 13:46:26.704683 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:27.259075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15245): Launched 13:46:27.577174 run osmo-stp_10.42.42.5(pid=15246): Launched 13:46:27.699510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:46:28.250604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15248): Launched 13:46:28.371809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:46:28.641319 run patchelf(pid=15249): Launched 13:46:28.818466 run osmo-stp_10.42.42.5(pid=15246): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15246)] 13:46:28.953544 run osmo-stp_10.42.42.5(pid=15246): stdout: | (launched: 2022-12-10_13:46:27.518603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:29.090692 run osmo-stp_10.42.42.5(pid=15246): stderr: | [0;m[38;5;43m20221210134627712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134627712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134627712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134627713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134627713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134627713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134627713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:29.228620 run osmo-stp_10.42.42.5(pid=15246): stdout: | (launched: 2022-12-10_13:46:27.518603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:29.360501 run osmo-stp_10.42.42.5(pid=15246): stderr: | [0;m[38;5;43m20221210134627712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134627712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134627712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134627713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134627713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134627713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134627713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:29.516708 run patchelf(pid=15249): Terminating (SIGINT) 13:46:29.696457 run patchelf(pid=15249): Terminated: ok {rc=0} 13:46:29.825922 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15246): Process ended prematurely: osmo-stp_10.42.42.5(pid=15246) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15246)] [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 13:46:29.836010 tst iperf3m4.py:8: Test FAILED (10.5 sec) 13:46:29.865536 run osmo-hlr_10.42.42.2(pid=15243): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15243)] 13:46:29.915861 run osmo-hlr_10.42.42.2(pid=15243): stdout: | (launched: 2022-12-10_13:46:26.523699) 13:46:29.967609 run osmo-hlr_10.42.42.2(pid=15243): stderr: | [0;m[1;31m20221210134626721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134626721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134626722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134626722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134626722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134626722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134626734 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134626742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134626742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134626742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:30.020076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15232): Terminating (SIGTERM) 13:46:30.062341 run iperf3-srv_10.42.42.10(pid=15233): Terminating (SIGTERM) 13:46:30.104317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15234): Terminating (SIGTERM) 13:46:30.146831 run iperf3-srv_10.42.42.10(pid=15235): Terminating (SIGTERM) 13:46:30.188624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15236): Terminating (SIGTERM) 13:46:30.230462 run iperf3-srv_10.42.42.10(pid=15237): Terminating (SIGTERM) 13:46:30.272228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15238): Terminating (SIGTERM) 13:46:30.314154 run iperf3-srv_10.42.42.10(pid=15239): Terminating (SIGTERM) 13:46:30.355823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15242): Terminating (SIGTERM) 13:46:30.397864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15245): Terminating (SIGTERM) 13:46:30.439765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15248): Terminating (SIGTERM) 13:46:30.482615 --- ParallelTerminationStrategy: PID 15232 died... 13:46:30.502588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15232): Terminated: ok {rc=0} 13:46:30.548875 --- ParallelTerminationStrategy: PID 15233 died... 13:46:30.568156 run iperf3-srv_10.42.42.10(pid=15233): Terminated {rc=256} 13:46:30.614505 --- ParallelTerminationStrategy: PID 15234 died... 13:46:30.633923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15234): Terminated: ok {rc=0} 13:46:30.680308 --- ParallelTerminationStrategy: PID 15235 died... 13:46:30.699751 run iperf3-srv_10.42.42.10(pid=15235): Terminated {rc=256} 13:46:30.745722 --- ParallelTerminationStrategy: PID 15236 died... 13:46:30.765057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15236): Terminated: ok {rc=0} 13:46:30.811258 --- ParallelTerminationStrategy: PID 15237 died... 13:46:30.830768 run iperf3-srv_10.42.42.10(pid=15237): Terminated {rc=256} 13:46:30.898412 --- ParallelTerminationStrategy: PID 15238 died... 13:46:30.918255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15238): Terminated: ok {rc=0} 13:46:30.965297 --- ParallelTerminationStrategy: PID 15239 died... 13:46:30.985076 run iperf3-srv_10.42.42.10(pid=15239): Terminated {rc=256} 13:46:31.031731 --- ParallelTerminationStrategy: PID 15242 died... 13:46:31.051698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15242): Terminated: ok {rc=0} 13:46:31.098625 --- ParallelTerminationStrategy: PID 15245 died... 13:46:31.118505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15245): Terminated: ok {rc=0} 13:46:31.165741 --- ParallelTerminationStrategy: PID 15248 died... 13:46:31.185882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15248): Terminated: ok {rc=0} 13:46:31.274363 bus /gobi_4: Setting Powered False 13:46:32.370658 bus /gobi_4: Setting Powered False 13:46:33.485970 bus /gobi_1: Setting Powered False 13:46:34.584088 bus /gobi_1: Setting Powered False 13:46:35.697378 bus /gobi_0: Setting Powered False 13:46:36.794375 bus /gobi_0: Setting Powered False 13:46:37.908511 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 13:46:39.010450 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:39.022441 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:46:39.064034 tst ping.py: using LAC 28813 13:46:39.188858 tst ping.py: using RAC 253 13:46:39.311180 tst ping.py: using CellId 28813 13:46:39.434050 tst ping.py: using BVCI 28814 13:46:39.549311 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:39.560384 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:39.571543 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:39.583078 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:39.594257 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:39.605537 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:39.616785 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:39.627972 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:46:39.742250 tst ping.py:19: start network... 13:46:39.936407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:40.386969 run create_hlr_db(pid=15250): Launched 13:46:40.506965 bus /gobi_6: Setting Powered False 13:46:41.565495 run create_hlr_db(pid=15250): Terminated: ok {rc=0} 13:46:41.992811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15252): Launched 13:46:42.304405 run osmo-hlr_10.42.42.2(pid=15253): Launched 13:46:42.423188 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:42.967258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15255): Launched 13:46:43.279090 run osmo-stp_10.42.42.5(pid=15256): Launched 13:46:43.398373 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:46:43.937593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15258): Launched 13:46:44.057401 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:46:44.323569 run patchelf(pid=15259): Launched 13:46:44.498301 run osmo-stp_10.42.42.5(pid=15256): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15256)] 13:46:44.631286 run osmo-stp_10.42.42.5(pid=15256): stdout: | (launched: 2022-12-10_13:46:43.222360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:44.765620 run osmo-stp_10.42.42.5(pid=15256): stderr: | [0;m[38;5;43m20221210134643415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134643415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134643415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134643416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134643416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134643416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134643416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:44.899770 run osmo-stp_10.42.42.5(pid=15256): stdout: | (launched: 2022-12-10_13:46:43.222360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:45.028558 run osmo-stp_10.42.42.5(pid=15256): stderr: | [0;m[38;5;43m20221210134643415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134643415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134643415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134643416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134643416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134643416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134643416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:45.182011 run patchelf(pid=15259): Terminating (SIGINT) 13:46:45.358389 run patchelf(pid=15259): Terminated: ok {rc=0} 13:46:45.485585 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15256): Process ended prematurely: osmo-stp_10.42.42.5(pid=15256) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15256)] [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 13:46:45.495013 tst ping.py:22: Test FAILED (6.5 sec) 13:46:45.523316 run osmo-hlr_10.42.42.2(pid=15253): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15253)] 13:46:45.573543 run osmo-hlr_10.42.42.2(pid=15253): stdout: | (launched: 2022-12-10_13:46:42.247741) 13:46:45.625470 run osmo-hlr_10.42.42.2(pid=15253): stderr: | [0;m[1;31m20221210134642445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134642446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134642446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134642446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134642446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134642446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134642458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134642468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134642468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134642468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:45.677848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15252): Terminating (SIGTERM) 13:46:45.719787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15255): Terminating (SIGTERM) 13:46:45.761662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15258): Terminating (SIGTERM) 13:46:45.803824 --- ParallelTerminationStrategy: PID 15252 died... 13:46:45.823600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15252): Terminated: ok {rc=0} 13:46:45.884611 --- ParallelTerminationStrategy: PID 15255 died... 13:46:45.910559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15255): Terminated: ok {rc=0} 13:46:45.958101 --- ParallelTerminationStrategy: PID 15258 died... 13:46:45.978265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15258): Terminated: ok {rc=0} 13:46:46.070111 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:46:47.157044 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:47.169460 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:46:47.213995 tst ping_idle_ping.py: using LAC 28814 13:46:47.348175 tst ping_idle_ping.py: using RAC 254 13:46:47.472037 tst ping_idle_ping.py: using CellId 28814 13:46:47.594741 tst ping_idle_ping.py: using BVCI 28815 13:46:47.702224 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:47.713324 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:47.724134 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:47.735125 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:47.746080 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:47.756943 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:47.768042 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:46:47.778768 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:46:47.891212 tst ping_idle_ping.py:24: start network... 13:46:48.087563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:48.549453 run create_hlr_db(pid=15260): Launched 13:46:48.671056 bus /gobi_6: Setting Powered False 13:46:49.730223 run create_hlr_db(pid=15260): Terminated: ok {rc=0} 13:46:50.160519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15262): Launched 13:46:50.474903 run osmo-hlr_10.42.42.2(pid=15263): Launched 13:46:50.595703 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:51.139791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15265): Launched 13:46:51.453037 run osmo-stp_10.42.42.5(pid=15266): Launched 13:46:51.573590 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:46:52.114854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15268): Launched 13:46:52.234046 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:46:52.497611 run patchelf(pid=15269): Launched 13:46:52.671398 run osmo-stp_10.42.42.5(pid=15266): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15266)] 13:46:52.804055 run osmo-stp_10.42.42.5(pid=15266): stdout: | (launched: 2022-12-10_13:46:51.396239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:52.938231 run osmo-stp_10.42.42.5(pid=15266): stderr: | [0;m[38;5;43m20221210134651587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134651587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134651588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134651588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134651588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134651589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134651589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:53.072197 run osmo-stp_10.42.42.5(pid=15266): stdout: | (launched: 2022-12-10_13:46:51.396239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:53.201630 run osmo-stp_10.42.42.5(pid=15266): stderr: | [0;m[38;5;43m20221210134651587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134651587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134651588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134651588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134651588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134651589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134651589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:53.354422 run patchelf(pid=15269): Terminating (SIGINT) 13:46:53.530782 run patchelf(pid=15269): Terminated: ok {rc=0} 13:46:53.657716 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15266): Process ended prematurely: osmo-stp_10.42.42.5(pid=15266) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15266)] [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 13:46:53.667082 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:46:53.695006 run osmo-hlr_10.42.42.2(pid=15263): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15263)] 13:46:53.744911 run osmo-hlr_10.42.42.2(pid=15263): stdout: | (launched: 2022-12-10_13:46:50.417989) 13:46:53.796362 run osmo-hlr_10.42.42.2(pid=15263): stderr: | [0;m[1;31m20221210134650614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134650614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134650614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134650614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134650614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134650614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134650626 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134650634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134650634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134650634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:53.848108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15262): Terminating (SIGTERM) 13:46:53.889608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15265): Terminating (SIGTERM) 13:46:53.931016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15268): Terminating (SIGTERM) 13:46:53.972622 --- ParallelTerminationStrategy: PID 15262 died... 13:46:53.992333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15262): Terminated: ok {rc=0} 13:46:54.038341 --- ParallelTerminationStrategy: PID 15265 died... 13:46:54.057651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15265): Terminated: ok {rc=0} 13:46:54.103672 --- ParallelTerminationStrategy: PID 15268 died... 13:46:54.122974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15268): Terminated: ok {rc=0} 13:46:54.210554 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:46:55.506490 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:55.514956 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:46:55.539174 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:46:55.577275 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:46:55.660378 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:46:55.683543 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:46:55.721371 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:46:56.320674 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:46:56.373949 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:46:56.385176 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:46:56.444685 tst cs_paging_gprs_active.py: using LAC 28815 13:46:56.572253 tst cs_paging_gprs_active.py: using RAC 255 13:46:56.696921 tst cs_paging_gprs_active.py: using CellId 28815 13:46:56.821034 tst cs_paging_gprs_active.py: using BVCI 28816 13:46:56.937060 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:46:56.948239 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:46:56.959378 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:46:56.970657 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:46:56.981862 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:46:56.993087 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:46:57.004406 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:46:57.015664 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:46:57.026960 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:46:57.141469 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:46:57.255482 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:46:57.454982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:46:57.754135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15273): Launched 13:46:58.013262 run iperf3-srv_10.42.42.10(pid=15274): Launched 13:46:58.124928 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:46:58.324738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:46:58.624861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15275): Launched 13:46:58.884315 run iperf3-srv_10.42.42.10(pid=15276): Launched 13:46:58.995861 tst cs_paging_gprs_active.py:38: start network... 13:46:59.194599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:59.656680 run create_hlr_db(pid=15277): Launched 13:46:59.778839 bus /gobi_6: Setting Powered False 13:47:00.852617 run create_hlr_db(pid=15277): Terminated: ok {rc=0} 13:47:01.316892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15279): Launched 13:47:01.663455 run osmo-hlr_10.42.42.2(pid=15280): Launched 13:47:01.903048 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:02.476345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15282): Launched 13:47:02.797755 run osmo-stp_10.42.42.5(pid=15283): Launched 13:47:02.911693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:47:03.426622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15285): Launched 13:47:03.539973 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:47:03.791058 run patchelf(pid=15286): Launched 13:47:03.956704 run osmo-stp_10.42.42.5(pid=15283): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15283)] 13:47:04.082518 run osmo-stp_10.42.42.5(pid=15283): stdout: | (launched: 2022-12-10_13:47:02.743841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:04.210173 run osmo-stp_10.42.42.5(pid=15283): stderr: | [0;m[38;5;43m20221210134702914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134702914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134702914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134702914 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134702915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134702915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134702915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:04.337316 run osmo-stp_10.42.42.5(pid=15283): stdout: | (launched: 2022-12-10_13:47:02.743841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:04.459710 run osmo-stp_10.42.42.5(pid=15283): stderr: | [0;m[38;5;43m20221210134702914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134702914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134702914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134702914 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134702915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134702915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134702915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:04.604097 run patchelf(pid=15286): Terminating (SIGINT) 13:47:04.771575 run patchelf(pid=15286): Terminated: ok {rc=0} 13:47:04.891901 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15283): Process ended prematurely: osmo-stp_10.42.42.5(pid=15283) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15283)] [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:47:04.901509 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:47:04.928315 run osmo-hlr_10.42.42.2(pid=15280): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15280)] 13:47:04.975621 run osmo-hlr_10.42.42.2(pid=15280): stdout: | (launched: 2022-12-10_13:47:01.593593) 13:47:05.024585 run osmo-hlr_10.42.42.2(pid=15280): stderr: | [0;m[1;31m20221210134701797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134701797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134701797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134701797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134701797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134701797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134701811 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134701835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134701835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134701835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:05.073949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15273): Terminating (SIGTERM) 13:47:05.113608 run iperf3-srv_10.42.42.10(pid=15274): Terminating (SIGTERM) 13:47:05.153158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15275): Terminating (SIGTERM) 13:47:05.192637 run iperf3-srv_10.42.42.10(pid=15276): Terminating (SIGTERM) 13:47:05.231995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15279): Terminating (SIGTERM) 13:47:05.271648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15282): Terminating (SIGTERM) 13:47:05.311165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15285): Terminating (SIGTERM) 13:47:05.350965 --- ParallelTerminationStrategy: PID 15273 died... 13:47:05.369919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15273): Terminated: ok {rc=0} 13:47:05.413613 --- ParallelTerminationStrategy: PID 15274 died... 13:47:05.431983 run iperf3-srv_10.42.42.10(pid=15274): Terminated {rc=256} 13:47:05.475335 --- ParallelTerminationStrategy: PID 15275 died... 13:47:05.493884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15275): Terminated: ok {rc=0} 13:47:05.537373 --- ParallelTerminationStrategy: PID 15276 died... 13:47:05.555739 run iperf3-srv_10.42.42.10(pid=15276): Terminated {rc=256} 13:47:05.599021 --- ParallelTerminationStrategy: PID 15279 died... 13:47:05.617458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15279): Terminated: ok {rc=0} 13:47:05.660830 --- ParallelTerminationStrategy: PID 15282 died... 13:47:05.679630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15282): Terminated: ok {rc=0} 13:47:05.723484 --- ParallelTerminationStrategy: PID 15285 died... 13:47:05.741735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15285): Terminated: ok {rc=0} 13:47:05.826235 bus /gobi_0: Setting Powered False 13:47:06.927449 bus /gobi_0: Setting Powered False 13:47:08.041748 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:47:09.188672 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:09.200718 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:47:09.267064 tst iperf3.py: using LAC 28816 13:47:09.392639 tst iperf3.py: using RAC 1 13:47:09.513295 tst iperf3.py: using CellId 28816 13:47:09.628816 tst iperf3.py: using BVCI 28817 13:47:09.736921 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:09.747844 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:09.758665 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:09.769361 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:09.779706 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:09.790249 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:09.800826 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:09.811380 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:09.822131 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:47:09.934988 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:47:10.134279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:47:10.433017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15288): Launched 13:47:10.692196 run iperf3-srv_10.42.42.10(pid=15289): Launched 13:47:10.803434 tst iperf3.py:8: start network... 13:47:11.002490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:11.462752 run create_hlr_db(pid=15290): Launched 13:47:11.583969 bus /gobi_6: Setting Powered False 13:47:12.642939 run create_hlr_db(pid=15290): Terminated: ok {rc=0} 13:47:13.077060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15292): Launched 13:47:13.396019 run osmo-hlr_10.42.42.2(pid=15293): Launched 13:47:13.519244 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:14.066997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15295): Launched 13:47:14.385615 run osmo-stp_10.42.42.5(pid=15296): Launched 13:47:14.508068 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:47:15.060798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15298): Launched 13:47:15.182490 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:47:15.451333 run patchelf(pid=15299): Launched 13:47:15.628362 run osmo-stp_10.42.42.5(pid=15296): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15296)] 13:47:15.763157 run osmo-stp_10.42.42.5(pid=15296): stdout: | (launched: 2022-12-10_13:47:14.327672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:15.914029 run osmo-stp_10.42.42.5(pid=15296): stderr: | [0;m[38;5;43m20221210134714521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134714521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134714521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134714522 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134714522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134714522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134714522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:16.044706 run osmo-stp_10.42.42.5(pid=15296): stdout: | (launched: 2022-12-10_13:47:14.327672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:16.171907 run osmo-stp_10.42.42.5(pid=15296): stderr: | [0;m[38;5;43m20221210134714521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134714521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134714521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134714522 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134714522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134714522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134714522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:16.322123 run patchelf(pid=15299): Terminating (SIGINT) 13:47:16.494881 run patchelf(pid=15299): Terminated: ok {rc=0} 13:47:16.620735 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15296): Process ended prematurely: osmo-stp_10.42.42.5(pid=15296) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15296)] [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 13:47:16.630694 tst iperf3.py:8: Test FAILED (7.5 sec) 13:47:16.658454 run osmo-hlr_10.42.42.2(pid=15293): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15293)] 13:47:16.708336 run osmo-hlr_10.42.42.2(pid=15293): stdout: | (launched: 2022-12-10_13:47:13.337286) 13:47:16.758995 run osmo-hlr_10.42.42.2(pid=15293): stderr: | [0;m[1;31m20221210134713535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134713535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134713535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134713535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134713535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134713535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134713547 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134713556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134713556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134713556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:16.809641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15288): Terminating (SIGTERM) 13:47:16.850562 run iperf3-srv_10.42.42.10(pid=15289): Terminating (SIGTERM) 13:47:16.891265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15292): Terminating (SIGTERM) 13:47:16.933479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15295): Terminating (SIGTERM) 13:47:16.976209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15298): Terminating (SIGTERM) 13:47:17.019288 --- ParallelTerminationStrategy: PID 15288 died... 13:47:17.038816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15288): Terminated: ok {rc=0} 13:47:17.085186 --- ParallelTerminationStrategy: PID 15289 died... 13:47:17.104307 run iperf3-srv_10.42.42.10(pid=15289): Terminated {rc=256} 13:47:17.149945 --- ParallelTerminationStrategy: PID 15292 died... 13:47:17.169029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15292): Terminated: ok {rc=0} 13:47:17.213173 --- ParallelTerminationStrategy: PID 15295 died... 13:47:17.232004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15295): Terminated: ok {rc=0} 13:47:17.275354 --- ParallelTerminationStrategy: PID 15298 died... 13:47:17.293780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15298): Terminated: ok {rc=0} 13:47:17.378597 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:47:18.524484 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:18.535944 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:47:18.595629 tst iperf3m4.py: using LAC 28817 13:47:18.717548 tst iperf3m4.py: using RAC 2 13:47:18.835233 tst iperf3m4.py: using CellId 28817 13:47:18.955850 tst iperf3m4.py: using BVCI 28818 13:47:19.065232 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:19.076001 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:19.086619 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:19.097224 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:19.107887 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:19.119022 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:19.129735 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:19.140117 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:19.150787 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:47:19.269075 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:47:19.386970 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:47:19.502456 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:47:19.617387 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:47:19.816789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:47:20.114850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15300): Launched 13:47:20.372610 run iperf3-srv_10.42.42.10(pid=15301): Launched 13:47:20.483539 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:47:20.681398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:47:20.979231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15302): Launched 13:47:21.237123 run iperf3-srv_10.42.42.10(pid=15303): Launched 13:47:21.348206 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:47:21.546487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:47:21.844179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15304): Launched 13:47:22.103330 run iperf3-srv_10.42.42.10(pid=15305): Launched 13:47:22.214013 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:47:22.412042 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:47:22.709422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15306): Launched 13:47:22.967184 run iperf3-srv_10.42.42.10(pid=15307): Launched 13:47:23.078024 tst iperf3m4.py:8: start network... 13:47:23.275834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:23.735136 run create_hlr_db(pid=15308): Launched 13:47:23.856541 bus /gobi_6: Setting Powered False 13:47:24.916599 run create_hlr_db(pid=15308): Terminated: ok {rc=0} 13:47:25.351280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15310): Launched 13:47:25.669014 run osmo-hlr_10.42.42.2(pid=15311): Launched 13:47:25.790459 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:26.343240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15313): Launched 13:47:26.660313 run osmo-stp_10.42.42.5(pid=15314): Launched 13:47:26.781512 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:47:27.329776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15316): Launched 13:47:27.451009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:47:27.721148 run patchelf(pid=15317): Launched 13:47:27.897630 run osmo-stp_10.42.42.5(pid=15314): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15314)] 13:47:28.032018 run osmo-stp_10.42.42.5(pid=15314): stdout: | (launched: 2022-12-10_13:47:26.602610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:28.169208 run osmo-stp_10.42.42.5(pid=15314): stderr: | [0;m[38;5;43m20221210134726795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134726795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134726795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134726796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134726796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134726796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134726796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:28.305693 run osmo-stp_10.42.42.5(pid=15314): stdout: | (launched: 2022-12-10_13:47:26.602610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:28.436581 run osmo-stp_10.42.42.5(pid=15314): stderr: | [0;m[38;5;43m20221210134726795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134726795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134726795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134726796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134726796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134726796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134726796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:28.591585 run patchelf(pid=15317): Terminating (SIGINT) 13:47:28.770084 run patchelf(pid=15317): Terminated: ok {rc=0} 13:47:28.899180 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15314): Process ended prematurely: osmo-stp_10.42.42.5(pid=15314) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15314)] [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:47:28.909431 tst iperf3m4.py:8: Test FAILED (10.4 sec) 13:47:28.938821 run osmo-hlr_10.42.42.2(pid=15311): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15311)] 13:47:28.988757 run osmo-hlr_10.42.42.2(pid=15311): stdout: | (launched: 2022-12-10_13:47:25.610955) 13:47:29.040180 run osmo-hlr_10.42.42.2(pid=15311): stderr: | [0;m[1;31m20221210134725808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134725809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134725809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134725809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134725809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134725809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134725822 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134725830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134725830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134725830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:29.092013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15300): Terminating (SIGTERM) 13:47:29.133875 run iperf3-srv_10.42.42.10(pid=15301): Terminating (SIGTERM) 13:47:29.175708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15302): Terminating (SIGTERM) 13:47:29.217423 run iperf3-srv_10.42.42.10(pid=15303): Terminating (SIGTERM) 13:47:29.259044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15304): Terminating (SIGTERM) 13:47:29.300710 run iperf3-srv_10.42.42.10(pid=15305): Terminating (SIGTERM) 13:47:29.342266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15306): Terminating (SIGTERM) 13:47:29.384040 run iperf3-srv_10.42.42.10(pid=15307): Terminating (SIGTERM) 13:47:29.425531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15310): Terminating (SIGTERM) 13:47:29.467041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15313): Terminating (SIGTERM) 13:47:29.508580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15316): Terminating (SIGTERM) 13:47:29.550283 --- ParallelTerminationStrategy: PID 15300 died... 13:47:29.570083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15300): Terminated: ok {rc=0} 13:47:29.616181 --- ParallelTerminationStrategy: PID 15301 died... 13:47:29.635665 run iperf3-srv_10.42.42.10(pid=15301): Terminated {rc=256} 13:47:29.681490 --- ParallelTerminationStrategy: PID 15302 died... 13:47:29.700877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15302): Terminated: ok {rc=0} 13:47:29.746896 --- ParallelTerminationStrategy: PID 15303 died... 13:47:29.766303 run iperf3-srv_10.42.42.10(pid=15303): Terminated {rc=256} 13:47:29.812114 --- ParallelTerminationStrategy: PID 15304 died... 13:47:29.831280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15304): Terminated: ok {rc=0} 13:47:29.877737 --- ParallelTerminationStrategy: PID 15305 died... 13:47:29.897415 run iperf3-srv_10.42.42.10(pid=15305): Terminated {rc=256} 13:47:29.942978 --- ParallelTerminationStrategy: PID 15306 died... 13:47:29.962553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15306): Terminated: ok {rc=0} 13:47:30.008720 --- ParallelTerminationStrategy: PID 15307 died... 13:47:30.028208 run iperf3-srv_10.42.42.10(pid=15307): Terminated {rc=256} 13:47:30.074201 --- ParallelTerminationStrategy: PID 15310 died... 13:47:30.093484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15310): Terminated: ok {rc=0} 13:47:30.139641 --- ParallelTerminationStrategy: PID 15313 died... 13:47:30.159089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15313): Terminated: ok {rc=0} 13:47:30.205392 --- ParallelTerminationStrategy: PID 15316 died... 13:47:30.224856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15316): Terminated: ok {rc=0} 13:47:30.312678 bus /gobi_4: Setting Powered False 13:47:31.407908 bus /gobi_4: Setting Powered False 13:47:32.525358 bus /gobi_1: Setting Powered False 13:47:33.623900 bus /gobi_1: Setting Powered False 13:47:34.738231 bus /gobi_0: Setting Powered False 13:47:35.835905 bus /gobi_0: Setting Powered False 13:47:36.953060 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:47:38.054673 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:38.066752 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:47:38.128430 tst ping.py: using LAC 28818 13:47:38.254330 tst ping.py: using RAC 3 13:47:38.379313 tst ping.py: using CellId 28818 13:47:38.507133 tst ping.py: using BVCI 28819 13:47:38.622834 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:38.634223 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:38.645461 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:38.656736 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:38.668128 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:38.679458 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:38.691045 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:38.702401 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:47:38.819930 tst ping.py:19: start network... 13:47:39.029957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:39.513920 run create_hlr_db(pid=15319): Launched 13:47:39.632461 bus /gobi_6: Setting Powered False 13:47:40.695078 run create_hlr_db(pid=15319): Terminated: ok {rc=0} 13:47:41.114774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15321): Launched 13:47:41.406751 run osmo-hlr_10.42.42.2(pid=15322): Launched 13:47:41.517107 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:42.026455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15324): Launched 13:47:42.317655 run osmo-stp_10.42.42.5(pid=15325): Launched 13:47:42.428258 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:47:42.931763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15327): Launched 13:47:43.043352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:47:43.290036 run patchelf(pid=15328): Launched 13:47:43.451356 run osmo-stp_10.42.42.5(pid=15325): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15325)] 13:47:43.574601 run osmo-stp_10.42.42.5(pid=15325): stdout: | (launched: 2022-12-10_13:47:42.264299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:43.698927 run osmo-stp_10.42.42.5(pid=15325): stderr: | [0;m[38;5;43m20221210134742436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134742436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134742436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134742436 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134742437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134742437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134742437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:43.823709 run osmo-stp_10.42.42.5(pid=15325): stdout: | (launched: 2022-12-10_13:47:42.264299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:43.942827 run osmo-stp_10.42.42.5(pid=15325): stderr: | [0;m[38;5;43m20221210134742436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134742436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134742436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134742436 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134742437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134742437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134742437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:44.084094 run patchelf(pid=15328): Terminating (SIGINT) 13:47:44.248400 run patchelf(pid=15328): Terminated: ok {rc=0} 13:47:44.366493 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15325): Process ended prematurely: osmo-stp_10.42.42.5(pid=15325) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15325)] [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 13:47:44.375222 tst ping.py:22: Test FAILED (6.3 sec) 13:47:44.401291 run osmo-hlr_10.42.42.2(pid=15322): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15322)] 13:47:44.447650 run osmo-hlr_10.42.42.2(pid=15322): stdout: | (launched: 2022-12-10_13:47:41.353166) 13:47:44.495960 run osmo-hlr_10.42.42.2(pid=15322): stderr: | [0;m[1;31m20221210134741529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134741529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134741529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134741529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134741529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134741529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134741544 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134741554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134741554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134741554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:44.544409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15321): Terminating (SIGTERM) 13:47:44.582940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15324): Terminating (SIGTERM) 13:47:44.621396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15327): Terminating (SIGTERM) 13:47:44.660038 --- ParallelTerminationStrategy: PID 15321 died... 13:47:44.678674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15321): Terminated: ok {rc=0} 13:47:44.721381 --- ParallelTerminationStrategy: PID 15324 died... 13:47:44.739288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15324): Terminated: ok {rc=0} 13:47:44.782345 --- ParallelTerminationStrategy: PID 15327 died... 13:47:44.800416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15327): Terminated: ok {rc=0} 13:47:44.883668 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:47:45.980187 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:45.996632 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:47:46.077711 tst ping_idle_ping.py: using LAC 28819 13:47:46.200854 tst ping_idle_ping.py: using RAC 4 13:47:46.328534 tst ping_idle_ping.py: using CellId 28819 13:47:46.476639 tst ping_idle_ping.py: using BVCI 28820 13:47:46.587632 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:46.599402 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:46.610935 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:46.623119 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:46.635762 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:46.647397 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:46.659660 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:47:46.672307 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:47:46.786361 tst ping_idle_ping.py:24: start network... 13:47:46.987046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:47.446749 run create_hlr_db(pid=15329): Launched 13:47:47.570868 bus /gobi_6: Setting Powered False 13:47:48.632572 run create_hlr_db(pid=15329): Terminated: ok {rc=0} 13:47:49.051676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15331): Launched 13:47:49.343806 run osmo-hlr_10.42.42.2(pid=15332): Launched 13:47:49.457464 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:49.961782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15334): Launched 13:47:50.252693 run osmo-stp_10.42.42.5(pid=15335): Launched 13:47:50.363018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:47:50.867322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15337): Launched 13:47:50.978044 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:47:51.225296 run patchelf(pid=15338): Launched 13:47:51.387316 run osmo-stp_10.42.42.5(pid=15335): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15335)] 13:47:51.511166 run osmo-stp_10.42.42.5(pid=15335): stdout: | (launched: 2022-12-10_13:47:50.199001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:51.635880 run osmo-stp_10.42.42.5(pid=15335): stderr: | [0;m[38;5;43m20221210134750367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134750367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134750368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134750368 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134750370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134750370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134750370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:51.760595 run osmo-stp_10.42.42.5(pid=15335): stdout: | (launched: 2022-12-10_13:47:50.199001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:51.880109 run osmo-stp_10.42.42.5(pid=15335): stderr: | [0;m[38;5;43m20221210134750367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134750367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134750368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134750368 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134750370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134750370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134750370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:52.021660 run patchelf(pid=15338): Terminating (SIGINT) 13:47:52.186440 run patchelf(pid=15338): Terminated: ok {rc=0} 13:47:52.304744 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15335): Process ended prematurely: osmo-stp_10.42.42.5(pid=15335) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15335)] [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:47:52.313499 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 13:47:52.339434 run osmo-hlr_10.42.42.2(pid=15332): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15332)] 13:47:52.385817 run osmo-hlr_10.42.42.2(pid=15332): stdout: | (launched: 2022-12-10_13:47:49.289966) 13:47:52.433994 run osmo-hlr_10.42.42.2(pid=15332): stderr: | [0;m[1;31m20221210134749465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134749465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134749466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134749466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134749466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134749466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134749478 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134749486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134749487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134749487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:52.482572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15331): Terminating (SIGTERM) 13:47:52.521598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15334): Terminating (SIGTERM) 13:47:52.560237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15337): Terminating (SIGTERM) 13:47:52.599212 --- ParallelTerminationStrategy: PID 15331 died... 13:47:52.617810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15331): Terminated: ok {rc=0} 13:47:52.660675 --- ParallelTerminationStrategy: PID 15334 died... 13:47:52.678976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15334): Terminated: ok {rc=0} 13:47:52.721678 --- ParallelTerminationStrategy: PID 15337 died... 13:47:52.739750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15337): Terminated: ok {rc=0} 13:47:52.823393 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 13:47:54.112164 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:47:54.121772 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:47:54.146285 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:47:54.181501 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:47:54.235587 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:47:54.259818 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:47:54.295542 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:47:54.851881 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:47:54.857202 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:47:54.868690 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:47:54.927383 tst switch_tch_pdch.py: using LAC 28820 13:47:55.044060 tst switch_tch_pdch.py: using RAC 5 13:47:55.168026 tst switch_tch_pdch.py: using CellId 28820 13:47:55.290738 tst switch_tch_pdch.py: using BVCI 28821 13:47:55.406706 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:47:55.418674 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:47:55.430335 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:47:55.442221 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:47:55.454002 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:47:55.465935 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:47:55.477910 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:47:55.489660 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:47:55.607601 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:47:55.722416 tst switch_tch_pdch.py:51: start network... 13:47:55.917798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:56.369435 run create_hlr_db(pid=15343): Launched 13:47:56.490367 bus /gobi_6: Setting Powered False 13:47:57.548683 run create_hlr_db(pid=15343): Terminated: ok {rc=0} 13:47:57.975440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15345): Launched 13:47:58.285832 run osmo-hlr_10.42.42.2(pid=15346): Launched 13:47:58.407237 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:58.948590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15348): Launched 13:47:59.243005 run osmo-stp_10.42.42.5(pid=15349): Launched 13:47:59.353831 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:47:59.858864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15351): Launched 13:47:59.969713 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:48:00.215412 run patchelf(pid=15352): Launched 13:48:00.377734 run osmo-stp_10.42.42.5(pid=15349): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15349)] 13:48:00.501712 run osmo-stp_10.42.42.5(pid=15349): stdout: | (launched: 2022-12-10_13:47:59.189100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:00.626615 run osmo-stp_10.42.42.5(pid=15349): stderr: | [0;m[38;5;43m20221210134759359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134759359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134759359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134759360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134759360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134759360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134759360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:00.752052 run osmo-stp_10.42.42.5(pid=15349): stdout: | (launched: 2022-12-10_13:47:59.189100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:00.884243 run osmo-stp_10.42.42.5(pid=15349): stderr: | [0;m[38;5;43m20221210134759359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134759359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134759359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134759360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134759360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134759360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134759360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:01.029487 run patchelf(pid=15352): Terminating (SIGINT) 13:48:01.198340 run patchelf(pid=15352): Terminated: ok {rc=0} 13:48:01.319635 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15349): Process ended prematurely: osmo-stp_10.42.42.5(pid=15349) [trial-2375↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15349)] [trial-2375↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:48:01.329060 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 13:48:01.356517 run osmo-hlr_10.42.42.2(pid=15346): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15346)] 13:48:01.404505 run osmo-hlr_10.42.42.2(pid=15346): stdout: | (launched: 2022-12-10_13:47:58.229481) 13:48:01.453952 run osmo-hlr_10.42.42.2(pid=15346): stderr: | [0;m[1;31m20221210134758426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134758426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134758426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134758426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134758426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134758426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134758439 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134758448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134758448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134758448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:01.503569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15345): Terminating (SIGTERM) 13:48:01.544458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15348): Terminating (SIGTERM) 13:48:01.586846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15351): Terminating (SIGTERM) 13:48:01.627466 --- ParallelTerminationStrategy: PID 15345 died... 13:48:01.647635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15345): Terminated: ok {rc=0} 13:48:01.691954 --- ParallelTerminationStrategy: PID 15348 died... 13:48:01.710757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15348): Terminated: ok {rc=0} 13:48:01.754498 --- ParallelTerminationStrategy: PID 15351 died... 13:48:01.773284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15351): Terminated: ok {rc=0} 13:48:01.858758 bus /gobi_0: Setting Powered False 13:48:02.954838 bus /gobi_0: Setting Powered False 13:48:04.071884 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 sms:nanobts+band-900 --------------------------------------------------------------------- 13:48:05.311081 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:05.315670 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 13:48:05.346710 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 13:48:05.372459 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 13:48:05.422893 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 13:48:05.453966 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 13:48:05.479675 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 13:48:06.025689 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 13:48:06.030600 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:48:06.041055 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 13:48:06.085410 tst mo_mt_sms.py: using LAC 28821 13:48:06.209839 tst mo_mt_sms.py: using RAC 6 13:48:06.334775 tst mo_mt_sms.py: using CellId 28821 13:48:06.456790 tst mo_mt_sms.py: using BVCI 28822 13:48:06.570029 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:48:06.580821 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:48:06.591827 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:48:06.602747 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:48:06.613707 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:48:06.624528 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 13:48:06.741505 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 13:48:06.856084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:07.307736 run create_hlr_db(pid=15356): Launched 13:48:07.427738 bus /gobi_6: Setting Powered False 13:48:08.486041 run create_hlr_db(pid=15356): Terminated: ok {rc=0} 13:48:08.892512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15358): Launched 13:48:09.184288 run osmo-hlr_10.42.42.2(pid=15359): Launched 13:48:09.294513 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:09.794676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15361): Launched 13:48:10.084889 run osmo-stp_10.42.42.5(pid=15362): Launched 13:48:10.194782 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:10.721269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15364): Launched 13:48:11.013311 run osmo-msc_10.42.42.6(pid=15365): Launched 13:48:11.177812 run osmo-stp_10.42.42.5(pid=15362): ERR: Terminated: ERROR {rc=1} [trial-2375↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15362)] 13:48:11.302091 run osmo-stp_10.42.42.5(pid=15362): stdout: | (launched: 2022-12-10_13:48:10.031506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:11.425688 run osmo-stp_10.42.42.5(pid=15362): stderr: | [0;m[38;5;43m20221210134810201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134810202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134810202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134810202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134810203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134810203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134810203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:11.547351 run osmo-stp_10.42.42.5(pid=15362): stdout: | (launched: 2022-12-10_13:48:10.031506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:11.663202 run osmo-stp_10.42.42.5(pid=15362): stderr: | [0;m[38;5;43m20221210134810201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134810202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134810202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134810202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134810203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134810203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134810203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:11.801818 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15362): Process ended prematurely: osmo-stp_10.42.42.5(pid=15362) [trial-2375↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15362)] [trial-2375↪sms:nanobts+band-900↪mo_mt_sms.py:16] 13:48:11.809650 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 13:48:11.835212 run osmo-hlr_10.42.42.2(pid=15359): ERR: Terminated: ERROR {rc=237} [trial-2375↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15359)] 13:48:11.882306 run osmo-hlr_10.42.42.2(pid=15359): stdout: | (launched: 2022-12-10_13:48:09.130166) 13:48:11.930988 run osmo-hlr_10.42.42.2(pid=15359): stderr: | [0;m[1;31m20221210134809303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134809303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134809303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134809303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134809303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134809303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134809315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134809324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134809324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134809324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:11.999307 run osmo-msc_10.42.42.6(pid=15365): ERR: Terminated: ERROR {rc=2} [trial-2375↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15365)] 13:48:12.046159 run osmo-msc_10.42.42.6(pid=15365): stdout: | (launched: 2022-12-10_13:48:10.959568) 13:48:12.094503 run osmo-msc_10.42.42.6(pid=15365): stderr: | [0;m[38;5;43m20221210134811230 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134811231 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f59bde2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134811231 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134811231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134811231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134811231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134811233 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134811233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134811234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134811234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:12.143589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15358): Terminating (SIGTERM) 13:48:12.182473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15361): Terminating (SIGTERM) 13:48:12.221354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15364): Terminating (SIGTERM) 13:48:12.260553 --- ParallelTerminationStrategy: PID 15358 died... 13:48:12.279362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15358): Terminated: ok {rc=0} 13:48:12.322435 --- ParallelTerminationStrategy: PID 15361 died... 13:48:12.340573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15361): Terminated: ok {rc=0} 13:48:12.383766 --- ParallelTerminationStrategy: PID 15364 died... 13:48:12.402176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15364): Terminated: ok {rc=0} 13:48:12.484420 bus /sierra_3: Setting Powered False 13:48:13.581870 bus /sierra_3: Setting Powered False 13:48:14.696103 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 13:48:15.934717 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:15.939210 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 13:48:15.995187 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 13:48:16.002298 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 13:48:16.036916 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 13:48:16.070450 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 13:48:16.077950 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 13:48:16.626548 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2375 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 13:48:16.636029 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 13:48:16.651749 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 13:48:16.706529 tst assert_extension.py: using LAC 28822 13:48:16.864370 tst assert_extension.py: using RAC 7 13:48:16.990842 tst assert_extension.py: using CellId 28822 13:48:17.161438 tst assert_extension.py: using BVCI 28823 13:48:17.298087 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 13:48:17.419769 tst assert_extension.py:10: start nitb and bts... 13:48:17.630639 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:48:18.265359 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15370): Launched 13:48:18.576129 run osmo-nitb_10.42.42.2(pid=15371): Launched 13:48:18.748547 run osmo-nitb_10.42.42.2(pid=15371): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15371)] 13:48:18.889461 run osmo-nitb_10.42.42.2(pid=15371): stdout: | (launched: 2022-12-10_13:48:18.519599) 13:48:19.031298 run osmo-nitb_10.42.42.2(pid=15371): stderr: | (launched: 2022-12-10_13:48:18.566192) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:48:19.172567 run osmo-nitb_10.42.42.2(pid=15371): stdout: | (launched: 2022-12-10_13:48:18.519599) 13:48:19.309621 run osmo-nitb_10.42.42.2(pid=15371): stderr: | (launched: 2022-12-10_13:48:18.566192) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15371): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15371) [trial-2375↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15371)] 13:48:19.694206 tst osmo-nitb_10.42.42.2(pid=15371): stdout: | (launched: 2022-12-10_13:48:18.519599) 13:48:19.820427 tst osmo-nitb_10.42.42.2(pid=15371): stderr: | (launched: 2022-12-10_13:48:18.566192) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:48:19.968728 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15371): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15371) [trial-2375↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15371)] [trial-2375↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 13:48:19.978037 tst assert_extension.py:12: Test FAILED (3.3 sec) 13:48:19.985223 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15370): Terminating (SIGTERM) 13:48:20.196446 --- ParallelTerminationStrategy: PID 15370 died... 13:48:20.217849 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15370): Terminated: ok {rc=0} 13:48:20.305507 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 ussd:nanobts+band-900 --------------------------------------------------------------------- 13:48:21.476456 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:21.481323 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 13:48:21.512384 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 13:48:21.538459 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 13:48:21.573144 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 13:48:21.605738 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 13:48:21.632813 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 13:48:22.158851 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2375 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 13:48:22.163635 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:48:22.174215 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 13:48:22.218645 tst assert_extension.py: using LAC 28823 13:48:22.334387 tst assert_extension.py: using RAC 8 13:48:22.448789 tst assert_extension.py: using CellId 28823 13:48:22.570532 tst assert_extension.py: using BVCI 28824 13:48:22.678402 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:48:22.688771 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:48:22.699198 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:48:22.709499 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:48:22.719715 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:48:22.729966 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 13:48:22.845113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:23.326746 run create_hlr_db(pid=15377): Launched 13:48:23.447436 bus /sierra_2: Setting Powered False 13:48:24.509165 run create_hlr_db(pid=15377): Terminated: ok {rc=0} 13:48:24.926170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15379): Launched 13:48:25.217473 run osmo-hlr_10.42.42.2(pid=15380): Launched 13:48:25.329640 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:25.834785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15382): Launched 13:48:26.125491 run osmo-stp_10.42.42.5(pid=15383): Launched 13:48:26.237030 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:26.765286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15385): Launched 13:48:27.055961 run osmo-msc_10.42.42.6(pid=15386): Launched 13:48:27.218427 run osmo-stp_10.42.42.5(pid=15383): ERR: Terminated: ERROR {rc=1} [trial-2375↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15383)] 13:48:27.343346 run osmo-stp_10.42.42.5(pid=15383): stdout: | (launched: 2022-12-10_13:48:26.071789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:27.467793 run osmo-stp_10.42.42.5(pid=15383): stderr: | [0;m[38;5;43m20221210134826240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134826241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134826241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134826241 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134826242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134826242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134826242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:27.589262 run osmo-stp_10.42.42.5(pid=15383): stdout: | (launched: 2022-12-10_13:48:26.071789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:27.705147 run osmo-stp_10.42.42.5(pid=15383): stderr: | [0;m[38;5;43m20221210134826240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134826241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134826241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134826241 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134826242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134826242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134826242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:27.843347 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15383): Process ended prematurely: osmo-stp_10.42.42.5(pid=15383) [trial-2375↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15383)] [trial-2375↪ussd:nanobts+band-900↪assert_extension.py:17] 13:48:27.851448 tst assert_extension.py:17: Test FAILED (5.7 sec) 13:48:27.876839 run osmo-hlr_10.42.42.2(pid=15380): ERR: Terminated: ERROR {rc=237} [trial-2375↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15380)] 13:48:27.923620 run osmo-hlr_10.42.42.2(pid=15380): stdout: | (launched: 2022-12-10_13:48:25.163924) 13:48:27.972331 run osmo-hlr_10.42.42.2(pid=15380): stderr: | [0;m[1;31m20221210134825340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134825340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134825340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134825340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134825340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134825340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134825355 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134825363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134825363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134825363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:28.040428 run osmo-msc_10.42.42.6(pid=15386): ERR: Terminated: ERROR {rc=2} [trial-2375↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15386)] 13:48:28.087238 run osmo-msc_10.42.42.6(pid=15386): stdout: | (launched: 2022-12-10_13:48:27.002454) 13:48:28.135923 run osmo-msc_10.42.42.6(pid=15386): stderr: | [0;m[38;5;43m20221210134827274 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134827274 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7facf3a50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134827274 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134827274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134827274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134827274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134827276 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134827276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134827276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134827277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:28.184925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15379): Terminating (SIGTERM) 13:48:28.224114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15382): Terminating (SIGTERM) 13:48:28.263493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15385): Terminating (SIGTERM) 13:48:28.303140 --- ParallelTerminationStrategy: PID 15379 died... 13:48:28.321926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15379): Terminated: ok {rc=0} 13:48:28.365352 --- ParallelTerminationStrategy: PID 15382 died... 13:48:28.383737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15382): Terminated: ok {rc=0} 13:48:28.427011 --- ParallelTerminationStrategy: PID 15385 died... 13:48:28.445498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15385): Terminated: ok {rc=0} 13:48:28.527635 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:48:29.738603 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:29.746435 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:48:29.780027 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:48:29.807260 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:48:29.859253 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:48:29.891958 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:48:29.919138 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:48:30.470612 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:48:30.523133 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:48:30.534779 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:48:30.601921 tst mo_mt_call.py: using LAC 28824 13:48:30.729936 tst mo_mt_call.py: using RAC 9 13:48:30.854978 tst mo_mt_call.py: using CellId 28824 13:48:30.999618 tst mo_mt_call.py: using BVCI 28825 13:48:31.121494 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:48:31.133764 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:48:31.146019 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:48:31.159034 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:48:31.172113 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:48:31.186123 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:48:31.314659 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:48:31.462024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:31.998774 run create_hlr_db(pid=15391): Launched 13:48:32.134451 bus /sierra_2: Setting Powered False 13:48:33.194422 run create_hlr_db(pid=15391): Terminated: ok {rc=0} 13:48:33.608646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15393): Launched 13:48:33.904616 run osmo-hlr_10.42.42.2(pid=15394): Launched 13:48:34.017205 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:34.527820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15396): Launched 13:48:34.823748 run osmo-stp_10.42.42.5(pid=15397): Launched 13:48:34.936170 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:35.472793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15399): Launched 13:48:35.769257 run osmo-msc_10.42.42.6(pid=15400): Launched 13:48:35.935643 run osmo-stp_10.42.42.5(pid=15397): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15397)] 13:48:36.061403 run osmo-stp_10.42.42.5(pid=15397): stdout: | (launched: 2022-12-10_13:48:34.769565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:36.187121 run osmo-stp_10.42.42.5(pid=15397): stderr: | [0;m[38;5;43m20221210134834939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134834939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134834940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134834940 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134834940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134834941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134834941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:36.310911 run osmo-stp_10.42.42.5(pid=15397): stdout: | (launched: 2022-12-10_13:48:34.769565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:36.428490 run osmo-stp_10.42.42.5(pid=15397): stderr: | [0;m[38;5;43m20221210134834939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134834939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134834940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134834940 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134834940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134834941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134834941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:36.570773 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15397): Process ended prematurely: osmo-stp_10.42.42.5(pid=15397) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15397)] [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:48:36.579627 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:48:36.605457 run osmo-hlr_10.42.42.2(pid=15394): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15394)] 13:48:36.652301 run osmo-hlr_10.42.42.2(pid=15394): stdout: | (launched: 2022-12-10_13:48:33.850253) 13:48:36.700784 run osmo-hlr_10.42.42.2(pid=15394): stderr: | [0;m[1;31m20221210134834027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134834027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134834027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134834027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134834027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134834027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134834046 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134834055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134834056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134834056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:36.768413 run osmo-msc_10.42.42.6(pid=15400): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15400)] 13:48:36.815269 run osmo-msc_10.42.42.6(pid=15400): stdout: | (launched: 2022-12-10_13:48:35.715284) 13:48:36.863574 run osmo-msc_10.42.42.6(pid=15400): stderr: | [0;m[38;5;43m20221210134835987 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134835987 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd205da7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134835988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134835988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134835988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134835988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134835990 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134835990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134835990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134835990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:36.912096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15393): Terminating (SIGTERM) 13:48:36.950768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15396): Terminating (SIGTERM) 13:48:36.989484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15399): Terminating (SIGTERM) 13:48:37.028429 --- ParallelTerminationStrategy: PID 15393 died... 13:48:37.047402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15393): Terminated: ok {rc=0} 13:48:37.090891 --- ParallelTerminationStrategy: PID 15396 died... 13:48:37.109340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15396): Terminated: ok {rc=0} 13:48:37.152414 --- ParallelTerminationStrategy: PID 15399 died... 13:48:37.170749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15399): Terminated: ok {rc=0} 13:48:37.255387 bus /sierra_3: Setting Powered False 13:48:38.353416 bus /sierra_3: Setting Powered False 13:48:39.467162 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:48:40.610951 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:48:40.622651 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:48:40.687958 tst mo_mt_call_osmux.py: using LAC 28825 13:48:40.805691 tst mo_mt_call_osmux.py: using RAC 10 13:48:40.927188 tst mo_mt_call_osmux.py: using CellId 28825 13:48:41.044567 tst mo_mt_call_osmux.py: using BVCI 28826 13:48:41.152191 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:48:41.163242 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:48:41.174120 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:48:41.184854 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:48:41.195785 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:48:41.206591 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:48:41.322639 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:48:41.436489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:41.899042 run create_hlr_db(pid=15402): Launched 13:48:42.019510 bus /sierra_2: Setting Powered False 13:48:43.078848 run create_hlr_db(pid=15402): Terminated: ok {rc=0} 13:48:43.513638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15404): Launched 13:48:43.833338 run osmo-hlr_10.42.42.2(pid=15405): Launched 13:48:43.955268 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:44.506152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15407): Launched 13:48:44.823853 run osmo-stp_10.42.42.5(pid=15408): Launched 13:48:44.945909 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:45.521133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15410): Launched 13:48:45.853494 run osmo-msc_10.42.42.6(pid=15411): Launched 13:48:46.081998 run osmo-stp_10.42.42.5(pid=15408): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15408)] 13:48:46.379915 run osmo-stp_10.42.42.5(pid=15408): stdout: | (launched: 2022-12-10_13:48:44.766228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:46.639253 run osmo-stp_10.42.42.5(pid=15408): stderr: | [0;m[38;5;43m20221210134844957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134844957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134844957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134844958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134844960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134844960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134844960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:46.807028 run osmo-stp_10.42.42.5(pid=15408): stdout: | (launched: 2022-12-10_13:48:44.766228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:46.928908 run osmo-stp_10.42.42.5(pid=15408): stderr: | [0;m[38;5;43m20221210134844957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134844957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134844957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134844958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134844960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134844960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134844960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:47.073984 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15408): Process ended prematurely: osmo-stp_10.42.42.5(pid=15408) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15408)] [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:48:47.083424 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:48:47.110746 run osmo-hlr_10.42.42.2(pid=15405): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15405)] 13:48:47.162220 run osmo-hlr_10.42.42.2(pid=15405): stdout: | (launched: 2022-12-10_13:48:43.775459) 13:48:47.212777 run osmo-hlr_10.42.42.2(pid=15405): stderr: | [0;m[1;31m20221210134843972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134843972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134843972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134843972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134843972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134843972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134843987 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134843995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134843996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134843996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:47.282894 run osmo-msc_10.42.42.6(pid=15411): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15411)] 13:48:47.332058 run osmo-msc_10.42.42.6(pid=15411): stdout: | (launched: 2022-12-10_13:48:45.780327) 13:48:47.382045 run osmo-msc_10.42.42.6(pid=15411): stderr: | [0;m[38;5;43m20221210134846272 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134846272 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3bbbee7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134846281 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134846281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134846281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134846281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134846283 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134846284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134846284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134846284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:47.431162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15404): Terminating (SIGTERM) 13:48:47.471192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15407): Terminating (SIGTERM) 13:48:47.510540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15410): Terminating (SIGTERM) 13:48:47.550106 --- ParallelTerminationStrategy: PID 15404 died... 13:48:47.569156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15404): Terminated: ok {rc=0} 13:48:47.612776 --- ParallelTerminationStrategy: PID 15407 died... 13:48:47.631226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15407): Terminated: ok {rc=0} 13:48:47.675045 --- ParallelTerminationStrategy: PID 15410 died... 13:48:47.693597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15410): Terminated: ok {rc=0} 13:48:47.779112 bus /sierra_3: Setting Powered False 13:48:48.878704 bus /sierra_3: Setting Powered False 13:48:49.990629 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:48:51.241975 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:51.249887 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:48:51.284733 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:48:51.312489 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:48:51.365837 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:48:51.399432 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:48:51.426997 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:48:51.980417 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:48:52.032261 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:48:52.043653 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:48:52.110077 tst mo_mt_call.py: using LAC 28826 13:48:52.233946 tst mo_mt_call.py: using RAC 11 13:48:52.360274 tst mo_mt_call.py: using CellId 28826 13:48:52.479903 tst mo_mt_call.py: using BVCI 28827 13:48:52.589180 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:48:52.600128 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:48:52.611025 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:48:52.621775 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:48:52.633103 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:48:52.644393 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:48:52.763494 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:48:52.879269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:53.339662 run create_hlr_db(pid=15424): Launched 13:48:53.461098 bus /sierra_2: Setting Powered False 13:48:54.520532 run create_hlr_db(pid=15424): Terminated: ok {rc=0} 13:48:54.952637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15426): Launched 13:48:55.268897 run osmo-hlr_10.42.42.2(pid=15427): Launched 13:48:55.390702 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:55.941660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15429): Launched 13:48:56.258854 run osmo-stp_10.42.42.5(pid=15430): Launched 13:48:56.380658 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:56.955087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15432): Launched 13:48:57.272853 run osmo-msc_10.42.42.6(pid=15433): Launched 13:48:57.450730 run osmo-stp_10.42.42.5(pid=15430): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15430)] 13:48:57.591871 run osmo-stp_10.42.42.5(pid=15430): stdout: | (launched: 2022-12-10_13:48:56.200623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:57.724504 run osmo-stp_10.42.42.5(pid=15430): stderr: | [0;m[38;5;43m20221210134856391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134856391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134856392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134856392 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134856394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134856395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134856395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:57.858230 run osmo-stp_10.42.42.5(pid=15430): stdout: | (launched: 2022-12-10_13:48:56.200623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:57.985255 run osmo-stp_10.42.42.5(pid=15430): stderr: | [0;m[38;5;43m20221210134856391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134856391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134856392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134856392 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134856394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134856395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134856395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:58.137089 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15430): Process ended prematurely: osmo-stp_10.42.42.5(pid=15430) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15430)] [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:48:58.146598 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:48:58.174797 run osmo-hlr_10.42.42.2(pid=15427): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15427)] 13:48:58.225642 run osmo-hlr_10.42.42.2(pid=15427): stdout: | (launched: 2022-12-10_13:48:55.211437) 13:48:58.277548 run osmo-hlr_10.42.42.2(pid=15427): stderr: | [0;m[1;31m20221210134855407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134855407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134855407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134855407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134855407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134855407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134855419 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134855428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134855428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134855428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:58.350022 run osmo-msc_10.42.42.6(pid=15433): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15433)] 13:48:58.399967 run osmo-msc_10.42.42.6(pid=15433): stdout: | (launched: 2022-12-10_13:48:57.215257) 13:48:58.451317 run osmo-msc_10.42.42.6(pid=15433): stderr: | [0;m[38;5;43m20221210134857538 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134857538 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f012e8d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134857538 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134857538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134857538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134857539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134857540 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134857541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134857541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134857541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:58.503299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15426): Terminating (SIGTERM) 13:48:58.545189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15429): Terminating (SIGTERM) 13:48:58.586740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15432): Terminating (SIGTERM) 13:48:58.628682 --- ParallelTerminationStrategy: PID 15426 died... 13:48:58.648466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15426): Terminated: ok {rc=0} 13:48:58.694473 --- ParallelTerminationStrategy: PID 15429 died... 13:48:58.713803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15429): Terminated: ok {rc=0} 13:48:58.760124 --- ParallelTerminationStrategy: PID 15432 died... 13:48:58.779539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15432): Terminated: ok {rc=0} 13:48:58.866529 bus /sierra_3: Setting Powered False 13:48:59.962865 bus /sierra_3: Setting Powered False 13:49:01.082146 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:49:02.243927 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:49:02.255657 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:49:02.321527 tst mo_mt_call_osmux.py: using LAC 28827 13:49:02.448356 tst mo_mt_call_osmux.py: using RAC 12 13:49:02.573443 tst mo_mt_call_osmux.py: using CellId 28827 13:49:02.695729 tst mo_mt_call_osmux.py: using BVCI 28828 13:49:02.805557 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:49:02.816444 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:49:02.827317 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:49:02.838515 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:49:02.849488 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:49:02.860209 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:49:02.973435 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:49:03.092483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:03.586610 run create_hlr_db(pid=15436): Launched 13:49:03.708354 bus /sierra_2: Setting Powered False 13:49:04.771601 run create_hlr_db(pid=15436): Terminated: ok {rc=0} 13:49:05.213301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15438): Launched 13:49:05.529926 run osmo-hlr_10.42.42.2(pid=15439): Launched 13:49:05.652338 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:06.205755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15441): Launched 13:49:06.522794 run osmo-stp_10.42.42.5(pid=15442): Launched 13:49:06.644607 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:07.218716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15444): Launched 13:49:07.536941 run osmo-msc_10.42.42.6(pid=15445): Launched 13:49:07.715184 run osmo-stp_10.42.42.5(pid=15442): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15442)] 13:49:07.851147 run osmo-stp_10.42.42.5(pid=15442): stdout: | (launched: 2022-12-10_13:49:06.465067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:07.987521 run osmo-stp_10.42.42.5(pid=15442): stderr: | [0;m[38;5;43m20221210134906657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134906658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134906658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134906658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134906659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134906659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134906659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:08.121467 run osmo-stp_10.42.42.5(pid=15442): stdout: | (launched: 2022-12-10_13:49:06.465067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:08.248196 run osmo-stp_10.42.42.5(pid=15442): stderr: | [0;m[38;5;43m20221210134906657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134906658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134906658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134906658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134906659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134906659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134906659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:08.399398 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15442): Process ended prematurely: osmo-stp_10.42.42.5(pid=15442) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15442)] [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:49:08.408886 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:49:08.436815 run osmo-hlr_10.42.42.2(pid=15439): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15439)] 13:49:08.486875 run osmo-hlr_10.42.42.2(pid=15439): stdout: | (launched: 2022-12-10_13:49:05.472493) 13:49:08.538142 run osmo-hlr_10.42.42.2(pid=15439): stderr: | [0;m[1;31m20221210134905672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134905672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134905672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134905672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134905672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134905672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134905684 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134905692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134905692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134905692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:08.609634 run osmo-msc_10.42.42.6(pid=15445): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15445)] 13:49:08.659298 run osmo-msc_10.42.42.6(pid=15445): stdout: | (launched: 2022-12-10_13:49:07.478855) 13:49:08.710765 run osmo-msc_10.42.42.6(pid=15445): stderr: | [0;m[38;5;43m20221210134907797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134907797 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fddd1c59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134907797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134907797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134907797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134907797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134907799 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134907799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134907799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134907800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:08.762349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15438): Terminating (SIGTERM) 13:49:08.803732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15441): Terminating (SIGTERM) 13:49:08.845425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15444): Terminating (SIGTERM) 13:49:08.887541 --- ParallelTerminationStrategy: PID 15438 died... 13:49:08.907446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15438): Terminated: ok {rc=0} 13:49:08.953946 --- ParallelTerminationStrategy: PID 15441 died... 13:49:08.973364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15441): Terminated: ok {rc=0} 13:49:09.019488 --- ParallelTerminationStrategy: PID 15444 died... 13:49:09.038803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15444): Terminated: ok {rc=0} 13:49:09.126125 bus /sierra_3: Setting Powered False 13:49:10.224819 bus /sierra_3: Setting Powered False 13:49:11.342715 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:49:12.590670 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:49:12.598509 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:49:12.630862 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:49:12.657818 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:49:12.710851 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:49:12.743915 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:49:12.770621 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:49:13.321460 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:49:13.372449 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:49:13.383959 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:49:13.450982 tst mo_mt_call.py: using LAC 28828 13:49:13.577538 tst mo_mt_call.py: using RAC 13 13:49:13.702255 tst mo_mt_call.py: using CellId 28828 13:49:13.829135 tst mo_mt_call.py: using BVCI 28829 13:49:13.946287 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:49:13.957804 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:49:13.969102 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:49:13.980626 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:49:13.992283 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:49:14.003859 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:49:14.118756 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:49:14.236283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:14.729638 run create_hlr_db(pid=15450): Launched 13:49:14.850110 bus /sierra_2: Setting Powered False 13:49:15.926191 run create_hlr_db(pid=15450): Terminated: ok {rc=0} 13:49:16.387801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15452): Launched 13:49:16.698190 run osmo-hlr_10.42.42.2(pid=15453): Launched 13:49:17.002627 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:17.655695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15455): Launched 13:49:17.952344 run osmo-stp_10.42.42.5(pid=15456): Launched 13:49:18.064584 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:18.601145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15458): Launched 13:49:18.897120 run osmo-msc_10.42.42.6(pid=15459): Launched 13:49:19.063086 run osmo-stp_10.42.42.5(pid=15456): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15456)] 13:49:19.189199 run osmo-stp_10.42.42.5(pid=15456): stdout: | (launched: 2022-12-10_13:49:17.897852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:19.314820 run osmo-stp_10.42.42.5(pid=15456): stderr: | [0;m[38;5;43m20221210134918067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134918067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134918067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134918068 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134918070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134918070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134918070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:19.438534 run osmo-stp_10.42.42.5(pid=15456): stdout: | (launched: 2022-12-10_13:49:17.897852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:19.556157 run osmo-stp_10.42.42.5(pid=15456): stderr: | [0;m[38;5;43m20221210134918067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134918067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134918067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134918068 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134918070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134918070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134918070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:19.697311 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15456): Process ended prematurely: osmo-stp_10.42.42.5(pid=15456) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15456)] [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:49:19.706085 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:49:19.732420 run osmo-hlr_10.42.42.2(pid=15453): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15453)] 13:49:19.779162 run osmo-hlr_10.42.42.2(pid=15453): stdout: | (launched: 2022-12-10_13:49:16.640312) 13:49:19.827794 run osmo-hlr_10.42.42.2(pid=15453): stderr: | [0;m[1;31m20221210134916878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134916878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134916878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134916878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134916878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134916878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134916892 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134916907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134916908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134916908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:19.895898 run osmo-msc_10.42.42.6(pid=15459): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15459)] 13:49:19.942789 run osmo-msc_10.42.42.6(pid=15459): stdout: | (launched: 2022-12-10_13:49:18.842699) 13:49:19.991286 run osmo-msc_10.42.42.6(pid=15459): stderr: | [0;m[38;5;43m20221210134919112 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134919112 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f277102bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134919112 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134919112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134919112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134919112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134919115 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134919116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134919116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134919116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:20.039831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15452): Terminating (SIGTERM) 13:49:20.078607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15455): Terminating (SIGTERM) 13:49:20.117274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15458): Terminating (SIGTERM) 13:49:20.156170 --- ParallelTerminationStrategy: PID 15452 died... 13:49:20.175016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15452): Terminated: ok {rc=0} 13:49:20.218071 --- ParallelTerminationStrategy: PID 15455 died... 13:49:20.236188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15455): Terminated: ok {rc=0} 13:49:20.279889 --- ParallelTerminationStrategy: PID 15458 died... 13:49:20.298085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15458): Terminated: ok {rc=0} 13:49:20.380409 bus /sierra_3: Setting Powered False 13:49:21.474261 bus /sierra_3: Setting Powered False 13:49:22.587228 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:49:23.732107 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:49:23.743938 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:49:23.813177 tst mo_mt_call_osmux.py: using LAC 28829 13:49:23.929308 tst mo_mt_call_osmux.py: using RAC 14 13:49:24.044839 tst mo_mt_call_osmux.py: using CellId 28829 13:49:24.160929 tst mo_mt_call_osmux.py: using BVCI 28830 13:49:24.268654 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:49:24.279705 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:49:24.290561 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:49:24.301467 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:49:24.312445 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:49:24.323267 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:49:24.436704 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:49:24.559430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:25.054458 run create_hlr_db(pid=15461): Launched 13:49:25.175730 bus /sierra_2: Setting Powered False 13:49:26.238659 run create_hlr_db(pid=15461): Terminated: ok {rc=0} 13:49:26.664041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15463): Launched 13:49:26.961831 run osmo-hlr_10.42.42.2(pid=15464): Launched 13:49:27.075083 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:27.600923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15466): Launched 13:49:27.899184 run osmo-stp_10.42.42.5(pid=15467): Launched 13:49:28.012261 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:28.550481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15469): Launched 13:49:28.848740 run osmo-msc_10.42.42.6(pid=15470): Launched 13:49:29.015932 run osmo-stp_10.42.42.5(pid=15467): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15467)] 13:49:29.142898 run osmo-stp_10.42.42.5(pid=15467): stdout: | (launched: 2022-12-10_13:49:27.844667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:29.269714 run osmo-stp_10.42.42.5(pid=15467): stderr: | [0;m[38;5;43m20221210134928014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134928014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134928015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134928015 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134928016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134928016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134928016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:29.393824 run osmo-stp_10.42.42.5(pid=15467): stdout: | (launched: 2022-12-10_13:49:27.844667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:29.512048 run osmo-stp_10.42.42.5(pid=15467): stderr: | [0;m[38;5;43m20221210134928014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134928014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134928015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134928015 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134928016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134928016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134928016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:29.653639 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15467): Process ended prematurely: osmo-stp_10.42.42.5(pid=15467) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15467)] [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:49:29.662364 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:49:29.688333 run osmo-hlr_10.42.42.2(pid=15464): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15464)] 13:49:29.735691 run osmo-hlr_10.42.42.2(pid=15464): stdout: | (launched: 2022-12-10_13:49:26.907326) 13:49:29.785400 run osmo-hlr_10.42.42.2(pid=15464): stderr: | [0;m[1;31m20221210134927084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134927084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134927084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134927084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134927084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134927084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134927096 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134927107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134927107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134927107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:29.853688 run osmo-msc_10.42.42.6(pid=15470): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15470)] 13:49:29.900695 run osmo-msc_10.42.42.6(pid=15470): stdout: | (launched: 2022-12-10_13:49:28.794064) 13:49:29.949292 run osmo-msc_10.42.42.6(pid=15470): stderr: | [0;m[38;5;43m20221210134929065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134929065 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9cb8911c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134929065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134929065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134929066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134929066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134929068 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134929069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134929069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134929069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:29.998128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15463): Terminating (SIGTERM) 13:49:30.037347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15466): Terminating (SIGTERM) 13:49:30.076389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15469): Terminating (SIGTERM) 13:49:30.115792 --- ParallelTerminationStrategy: PID 15463 died... 13:49:30.134644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15463): Terminated: ok {rc=0} 13:49:30.177953 --- ParallelTerminationStrategy: PID 15466 died... 13:49:30.196072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15466): Terminated: ok {rc=0} 13:49:30.239304 --- ParallelTerminationStrategy: PID 15469 died... 13:49:30.257670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15469): Terminated: ok {rc=0} 13:49:30.340074 bus /sierra_3: Setting Powered False 13:49:31.435957 bus /sierra_3: Setting Powered False 13:49:32.546912 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:49:33.796034 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:49:33.803940 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:49:33.837297 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:49:33.864199 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:49:33.915471 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:49:33.947857 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:49:33.974509 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:49:34.527765 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:49:34.579050 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:49:34.590222 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:49:34.655908 tst mo_mt_call.py: using LAC 28830 13:49:34.773877 tst mo_mt_call.py: using RAC 15 13:49:34.892340 tst mo_mt_call.py: using CellId 28830 13:49:35.010507 tst mo_mt_call.py: using BVCI 28831 13:49:35.118209 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:49:35.129130 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:49:35.139867 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:49:35.150626 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:49:35.161516 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:49:35.172189 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:49:35.290612 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:49:35.408655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:35.900209 run create_hlr_db(pid=15475): Launched 13:49:36.021494 bus /sierra_2: Setting Powered False 13:49:37.085182 run create_hlr_db(pid=15475): Terminated: ok {rc=0} 13:49:37.526302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15477): Launched 13:49:37.842423 run osmo-hlr_10.42.42.2(pid=15478): Launched 13:49:37.966074 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:38.517162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15480): Launched 13:49:38.833692 run osmo-stp_10.42.42.5(pid=15481): Launched 13:49:38.955110 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:39.528792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15483): Launched 13:49:39.845397 run osmo-msc_10.42.42.6(pid=15484): Launched 13:49:40.024291 run osmo-stp_10.42.42.5(pid=15481): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15481)] 13:49:40.159643 run osmo-stp_10.42.42.5(pid=15481): stdout: | (launched: 2022-12-10_13:49:38.776226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:40.295772 run osmo-stp_10.42.42.5(pid=15481): stderr: | [0;m[38;5;43m20221210134938967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134938967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134938967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134938968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134938968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134938968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134938968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:40.430586 run osmo-stp_10.42.42.5(pid=15481): stdout: | (launched: 2022-12-10_13:49:38.776226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:40.556819 run osmo-stp_10.42.42.5(pid=15481): stderr: | [0;m[38;5;43m20221210134938967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134938967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134938967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134938968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134938968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134938968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134938968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:40.708086 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15481): Process ended prematurely: osmo-stp_10.42.42.5(pid=15481) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15481)] [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:49:40.717488 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:49:40.745078 run osmo-hlr_10.42.42.2(pid=15478): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15478)] 13:49:40.794888 run osmo-hlr_10.42.42.2(pid=15478): stdout: | (launched: 2022-12-10_13:49:37.785185) 13:49:40.846084 run osmo-hlr_10.42.42.2(pid=15478): stderr: | [0;m[1;31m20221210134937984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134937984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134937984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134937984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134937984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134937984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134937994 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134938002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134938003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134938003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:40.917625 run osmo-msc_10.42.42.6(pid=15484): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15484)] 13:49:40.967087 run osmo-msc_10.42.42.6(pid=15484): stdout: | (launched: 2022-12-10_13:49:39.787867) 13:49:41.018332 run osmo-msc_10.42.42.6(pid=15484): stderr: | [0;m[38;5;43m20221210134940109 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134940109 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb3a78f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134940109 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134940109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134940110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134940110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134940111 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134940112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134940112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134940112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:41.070068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15477): Terminating (SIGTERM) 13:49:41.111441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15480): Terminating (SIGTERM) 13:49:41.152918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15483): Terminating (SIGTERM) 13:49:41.194908 --- ParallelTerminationStrategy: PID 15477 died... 13:49:41.214709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15477): Terminated: ok {rc=0} 13:49:41.261167 --- ParallelTerminationStrategy: PID 15480 died... 13:49:41.280243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15480): Terminated: ok {rc=0} 13:49:41.326188 --- ParallelTerminationStrategy: PID 15483 died... 13:49:41.345416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15483): Terminated: ok {rc=0} 13:49:41.432196 bus /sierra_3: Setting Powered False 13:49:42.530163 bus /sierra_3: Setting Powered False 13:49:43.644183 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:49:44.786974 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:49:44.798488 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:49:44.863696 tst mo_mt_call_osmux.py: using LAC 28831 13:49:44.980533 tst mo_mt_call_osmux.py: using RAC 16 13:49:45.099733 tst mo_mt_call_osmux.py: using CellId 28831 13:49:45.217177 tst mo_mt_call_osmux.py: using BVCI 28832 13:49:45.324616 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:49:45.335583 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:49:45.346383 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:49:45.357169 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:49:45.367940 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:49:45.378662 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:49:45.492210 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:49:45.610248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:46.117839 run create_hlr_db(pid=15486): Launched 13:49:46.267176 bus /sierra_2: Setting Powered False 13:49:47.337345 run create_hlr_db(pid=15486): Terminated: ok {rc=0} 13:49:47.791150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15488): Launched 13:49:48.109871 run osmo-hlr_10.42.42.2(pid=15489): Launched 13:49:48.234512 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:48.787361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15491): Launched 13:49:49.104815 run osmo-stp_10.42.42.5(pid=15492): Launched 13:49:49.226410 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:49.802103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15494): Launched 13:49:50.119355 run osmo-msc_10.42.42.6(pid=15495): Launched 13:49:50.298484 run osmo-stp_10.42.42.5(pid=15492): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15492)] 13:49:50.433591 run osmo-stp_10.42.42.5(pid=15492): stdout: | (launched: 2022-12-10_13:49:49.046502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:50.568572 run osmo-stp_10.42.42.5(pid=15492): stderr: | [0;m[38;5;43m20221210134949237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134949237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134949238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134949238 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134949238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134949238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134949239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:50.703347 run osmo-stp_10.42.42.5(pid=15492): stdout: | (launched: 2022-12-10_13:49:49.046502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:50.829470 run osmo-stp_10.42.42.5(pid=15492): stderr: | [0;m[38;5;43m20221210134949237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210134949237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210134949238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210134949238 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210134949238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210134949238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210134949239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:50.980540 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15492): Process ended prematurely: osmo-stp_10.42.42.5(pid=15492) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15492)] [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:49:50.989924 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:49:51.017813 run osmo-hlr_10.42.42.2(pid=15489): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15489)] 13:49:51.067313 run osmo-hlr_10.42.42.2(pid=15489): stdout: | (launched: 2022-12-10_13:49:48.051621) 13:49:51.118391 run osmo-hlr_10.42.42.2(pid=15489): stderr: | [0;m[1;31m20221210134948251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134948251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134948251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134948251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134948251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134948251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134948261 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134948270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134948270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134948270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:51.189714 run osmo-msc_10.42.42.6(pid=15495): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15495)] 13:49:51.239237 run osmo-msc_10.42.42.6(pid=15495): stdout: | (launched: 2022-12-10_13:49:50.061625) 13:49:51.290354 run osmo-msc_10.42.42.6(pid=15495): stderr: | [0;m[38;5;43m20221210134950401 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210134950401 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe982f7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210134950401 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210134950401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210134950401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210134950401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210134950403 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210134950403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210134950404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210134950404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:51.341871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15488): Terminating (SIGTERM) 13:49:51.382957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15491): Terminating (SIGTERM) 13:49:51.424039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15494): Terminating (SIGTERM) 13:49:51.465629 --- ParallelTerminationStrategy: PID 15488 died... 13:49:51.485303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15488): Terminated: ok {rc=0} 13:49:51.531031 --- ParallelTerminationStrategy: PID 15491 died... 13:49:51.550238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15491): Terminated: ok {rc=0} 13:49:51.595706 --- ParallelTerminationStrategy: PID 15494 died... 13:49:51.614857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15494): Terminated: ok {rc=0} 13:49:51.700915 bus /sierra_3: Setting Powered False 13:49:52.798706 bus /sierra_3: Setting Powered False 13:49:53.916835 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:49:55.161797 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:49:55.168674 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:49:55.199837 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:49:55.225865 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:49:55.277680 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:49:55.309636 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:49:55.335587 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:49:55.885917 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:49:55.940924 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:49:55.952628 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:49:56.020784 tst mo_mt_call.py: using LAC 28832 13:49:56.146481 tst mo_mt_call.py: using RAC 17 13:49:56.273756 tst mo_mt_call.py: using CellId 28832 13:49:56.400845 tst mo_mt_call.py: using BVCI 28833 13:49:56.517190 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:49:56.528556 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:49:56.539870 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:49:56.551943 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:49:56.564165 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:49:56.576140 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:49:56.693971 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:49:56.815807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:57.278640 run create_hlr_db(pid=15500): Launched 13:49:57.401411 bus /sierra_2: Setting Powered False 13:49:58.461629 run create_hlr_db(pid=15500): Terminated: ok {rc=0} 13:49:58.876497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15502): Launched 13:49:59.173153 run osmo-hlr_10.42.42.2(pid=15503): Launched 13:49:59.286172 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:59.798024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15505): Launched 13:50:00.094715 run osmo-stp_10.42.42.5(pid=15506): Launched 13:50:00.207430 run osmo-msc_10.42.42.6: Starting osmo-msc 13:50:00.746521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15508): Launched 13:50:01.058980 run osmo-msc_10.42.42.6(pid=15509): Launched 13:50:01.443613 run osmo-stp_10.42.42.5(pid=15506): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15506)] 13:50:01.697630 run osmo-stp_10.42.42.5(pid=15506): stdout: | (launched: 2022-12-10_13:50:00.040469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:01.864142 run osmo-stp_10.42.42.5(pid=15506): stderr: | [0;m[38;5;43m20221210135000212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135000212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135000213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135000213 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135000214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135000214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135000214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:02.112038 run osmo-stp_10.42.42.5(pid=15506): stdout: | (launched: 2022-12-10_13:50:00.040469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:02.235460 run osmo-stp_10.42.42.5(pid=15506): stderr: | [0;m[38;5;43m20221210135000212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135000212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135000213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135000213 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135000214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135000214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135000214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:02.379672 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15506): Process ended prematurely: osmo-stp_10.42.42.5(pid=15506) [trial-2375↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15506)] [trial-2375↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:50:02.388890 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:50:02.415854 run osmo-hlr_10.42.42.2(pid=15503): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15503)] 13:50:02.463242 run osmo-hlr_10.42.42.2(pid=15503): stdout: | (launched: 2022-12-10_13:49:59.118757) 13:50:02.511408 run osmo-hlr_10.42.42.2(pid=15503): stderr: | [0;m[1;31m20221210134959294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210134959294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210134959294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210134959294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210134959294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210134959294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210134959306 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210134959315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210134959315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210134959315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:02.578815 run osmo-msc_10.42.42.6(pid=15509): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15509)] 13:50:02.625623 run osmo-msc_10.42.42.6(pid=15509): stdout: | (launched: 2022-12-10_13:50:00.993764) 13:50:02.673825 run osmo-msc_10.42.42.6(pid=15509): stderr: | [0;m[38;5;43m20221210135001662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135001662 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb8864cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135001662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135001662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135001663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135001663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135001664 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135001666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135001666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135001666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:50:02.722573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15502): Terminating (SIGTERM) 13:50:02.761402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15505): Terminating (SIGTERM) 13:50:02.800175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15508): Terminating (SIGTERM) 13:50:02.839192 --- ParallelTerminationStrategy: PID 15502 died... 13:50:02.857896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15502): Terminated: ok {rc=0} 13:50:02.901105 --- ParallelTerminationStrategy: PID 15505 died... 13:50:02.919222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15505): Terminated: ok {rc=0} 13:50:02.962233 --- ParallelTerminationStrategy: PID 15508 died... 13:50:02.980634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15508): Terminated: ok {rc=0} 13:50:03.064041 bus /sierra_3: Setting Powered False 13:50:04.165389 bus /sierra_3: Setting Powered False 13:50:05.278840 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:50:06.425699 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:50:06.437858 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:50:06.507182 tst mo_mt_call_osmux.py: using LAC 28833 13:50:06.633397 tst mo_mt_call_osmux.py: using RAC 18 13:50:06.751579 tst mo_mt_call_osmux.py: using CellId 28833 13:50:06.871022 tst mo_mt_call_osmux.py: using BVCI 28834 13:50:06.980850 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:50:06.992124 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:50:07.003508 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:50:07.014543 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:50:07.025468 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:50:07.036198 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:50:07.150797 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:50:07.271512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:07.765413 run create_hlr_db(pid=15514): Launched 13:50:07.887208 bus /sierra_2: Setting Powered False 13:50:08.950466 run create_hlr_db(pid=15514): Terminated: ok {rc=0} 13:50:09.374900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15516): Launched 13:50:09.671236 run osmo-hlr_10.42.42.2(pid=15517): Launched 13:50:09.784428 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:10.297259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15519): Launched 13:50:10.594424 run osmo-stp_10.42.42.5(pid=15520): Launched 13:50:10.707695 run osmo-msc_10.42.42.6: Starting osmo-msc 13:50:11.245948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15522): Launched 13:50:11.542855 run osmo-msc_10.42.42.6(pid=15523): Launched 13:50:11.709259 run osmo-stp_10.42.42.5(pid=15520): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15520)] 13:50:11.835233 run osmo-stp_10.42.42.5(pid=15520): stdout: | (launched: 2022-12-10_13:50:10.539718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:11.960684 run osmo-stp_10.42.42.5(pid=15520): stderr: | [0;m[38;5;43m20221210135010708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135010708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135010709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135010709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135010710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135010710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135010710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:12.084513 run osmo-stp_10.42.42.5(pid=15520): stdout: | (launched: 2022-12-10_13:50:10.539718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:12.203020 run osmo-stp_10.42.42.5(pid=15520): stderr: | [0;m[38;5;43m20221210135010708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135010708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135010709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135010709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135010710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135010710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135010710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:12.344327 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15520): Process ended prematurely: osmo-stp_10.42.42.5(pid=15520) [trial-2375↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15520)] [trial-2375↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:50:12.353269 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:50:12.379141 run osmo-hlr_10.42.42.2(pid=15517): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15517)] 13:50:12.425855 run osmo-hlr_10.42.42.2(pid=15517): stdout: | (launched: 2022-12-10_13:50:09.617292) 13:50:12.474237 run osmo-hlr_10.42.42.2(pid=15517): stderr: | [0;m[1;31m20221210135009794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135009794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135009794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135009795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135009795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135009795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135009806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135009815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135009815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135009815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:12.541852 run osmo-msc_10.42.42.6(pid=15523): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15523)] 13:50:12.588402 run osmo-msc_10.42.42.6(pid=15523): stdout: | (launched: 2022-12-10_13:50:11.488317) 13:50:12.636704 run osmo-msc_10.42.42.6(pid=15523): stderr: | [0;m[38;5;43m20221210135011761 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135011761 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8fdc252c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135011761 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135011761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135011762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135011762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135011763 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135011764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135011764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135011764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:50:12.685363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15516): Terminating (SIGTERM) 13:50:12.724066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15519): Terminating (SIGTERM) 13:50:12.763020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15522): Terminating (SIGTERM) 13:50:12.802363 --- ParallelTerminationStrategy: PID 15516 died... 13:50:12.821294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15516): Terminated: ok {rc=0} 13:50:12.864639 --- ParallelTerminationStrategy: PID 15519 died... 13:50:12.883128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15519): Terminated: ok {rc=0} 13:50:12.926064 --- ParallelTerminationStrategy: PID 15522 died... 13:50:12.944432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15522): Terminated: ok {rc=0} 13:50:13.028248 bus /sierra_3: Setting Powered False 13:50:14.126751 bus /sierra_3: Setting Powered False 13:50:15.238047 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:50:16.481484 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:50:16.488709 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:50:16.524826 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 13:50:16.554904 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 13:50:16.611363 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:50:16.646283 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 13:50:16.675297 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 13:50:17.220565 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 13:50:17.270412 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:50:17.281755 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:50:17.329480 tst mo_mt_call.py: using LAC 28834 13:50:17.448199 tst mo_mt_call.py: using RAC 19 13:50:17.565429 tst mo_mt_call.py: using CellId 28834 13:50:17.682214 tst mo_mt_call.py: using BVCI 28835 13:50:17.790065 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:50:17.801492 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:50:17.812430 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:50:17.823439 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:50:17.834632 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:50:17.845632 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:50:17.964261 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:50:18.079843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:18.543320 run create_hlr_db(pid=15528): Launched 13:50:18.664526 bus /sierra_2: Setting Powered False 13:50:19.725252 run create_hlr_db(pid=15528): Terminated: ok {rc=0} 13:50:20.159261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15530): Launched 13:50:20.479389 run osmo-hlr_10.42.42.2(pid=15531): Launched 13:50:20.602058 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:21.151318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15533): Launched 13:50:21.470275 run osmo-stp_10.42.42.5(pid=15534): Launched 13:50:21.593347 run osmo-msc_10.42.42.6: Starting osmo-msc 13:50:22.168000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15536): Launched 13:50:22.486351 run osmo-msc_10.42.42.6(pid=15537): Launched 13:50:22.665387 run osmo-stp_10.42.42.5(pid=15534): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15534)] 13:50:22.799753 run osmo-stp_10.42.42.5(pid=15534): stdout: | (launched: 2022-12-10_13:50:21.412054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:22.934824 run osmo-stp_10.42.42.5(pid=15534): stderr: | [0;m[38;5;43m20221210135021604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135021604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135021604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135021605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135021605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135021605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135021605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:23.068686 run osmo-stp_10.42.42.5(pid=15534): stdout: | (launched: 2022-12-10_13:50:21.412054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:23.194897 run osmo-stp_10.42.42.5(pid=15534): stderr: | [0;m[38;5;43m20221210135021604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135021604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135021604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135021605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135021605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135021605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135021605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:23.346849 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15534): Process ended prematurely: osmo-stp_10.42.42.5(pid=15534) [trial-2375↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15534)] [trial-2375↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 13:50:23.356031 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:50:23.383933 run osmo-hlr_10.42.42.2(pid=15531): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15531)] 13:50:23.433836 run osmo-hlr_10.42.42.2(pid=15531): stdout: | (launched: 2022-12-10_13:50:20.420014) 13:50:23.485397 run osmo-hlr_10.42.42.2(pid=15531): stderr: | [0;m[1;31m20221210135020619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135020619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135020619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135020619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135020619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135020620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135020632 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135020640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135020640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135020640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:23.557382 run osmo-msc_10.42.42.6(pid=15537): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15537)] 13:50:23.607080 run osmo-msc_10.42.42.6(pid=15537): stdout: | (launched: 2022-12-10_13:50:22.428477) 13:50:23.658287 run osmo-msc_10.42.42.6(pid=15537): stderr: | [0;m[38;5;43m20221210135022747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135022747 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fccaea60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135022747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135022747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135022747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135022748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135022749 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135022750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135022750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135022750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:50:23.710081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15530): Terminating (SIGTERM) 13:50:23.751316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15533): Terminating (SIGTERM) 13:50:23.792704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15536): Terminating (SIGTERM) 13:50:23.834622 --- ParallelTerminationStrategy: PID 15530 died... 13:50:23.854359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15530): Terminated: ok {rc=0} 13:50:23.900369 --- ParallelTerminationStrategy: PID 15533 died... 13:50:23.919676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15533): Terminated: ok {rc=0} 13:50:23.965599 --- ParallelTerminationStrategy: PID 15536 died... 13:50:23.984834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15536): Terminated: ok {rc=0} 13:50:24.071614 bus /sierra_3: Setting Powered False 13:50:25.169110 bus /sierra_3: Setting Powered False 13:50:26.283357 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 13:50:27.423718 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:50:27.435682 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:50:27.486195 tst mo_mt_call_osmux.py: using LAC 28835 13:50:27.613439 tst mo_mt_call_osmux.py: using RAC 20 13:50:27.738823 tst mo_mt_call_osmux.py: using CellId 28835 13:50:27.865855 tst mo_mt_call_osmux.py: using BVCI 28836 13:50:27.982274 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:50:27.994123 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:50:28.005723 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:50:28.017594 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:50:28.029406 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:50:28.041035 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:50:28.158007 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:50:28.273398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:28.734721 run create_hlr_db(pid=15539): Launched 13:50:28.856436 bus /sierra_2: Setting Powered False 13:50:29.916083 run create_hlr_db(pid=15539): Terminated: ok {rc=0} 13:50:30.351491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15541): Launched 13:50:30.669854 run osmo-hlr_10.42.42.2(pid=15542): Launched 13:50:30.791549 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:31.456777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15544): Launched 13:50:31.787720 run osmo-stp_10.42.42.5(pid=15545): Launched 13:50:32.126291 run osmo-msc_10.42.42.6: Starting osmo-msc 13:50:32.783853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15547): Launched 13:50:33.101659 run osmo-msc_10.42.42.6(pid=15548): Launched 13:50:33.280065 run osmo-stp_10.42.42.5(pid=15545): ERR: Terminated: ERROR {rc=1} [trial-2375↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15545)] 13:50:33.415302 run osmo-stp_10.42.42.5(pid=15545): stdout: | (launched: 2022-12-10_13:50:31.716854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:33.550520 run osmo-stp_10.42.42.5(pid=15545): stderr: | [0;m[38;5;43m20221210135031989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135031990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135031991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135031991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135031997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135031997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135031997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:33.685022 run osmo-stp_10.42.42.5(pid=15545): stdout: | (launched: 2022-12-10_13:50:31.716854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:33.811777 run osmo-stp_10.42.42.5(pid=15545): stderr: | [0;m[38;5;43m20221210135031989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135031990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135031991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135031991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135031997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135031997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135031997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:33.963571 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15545): Process ended prematurely: osmo-stp_10.42.42.5(pid=15545) [trial-2375↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15545)] [trial-2375↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 13:50:33.973028 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 13:50:34.000940 run osmo-hlr_10.42.42.2(pid=15542): ERR: Terminated: ERROR {rc=237} [trial-2375↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15542)] 13:50:34.050881 run osmo-hlr_10.42.42.2(pid=15542): stdout: | (launched: 2022-12-10_13:50:30.612147) 13:50:34.102493 run osmo-hlr_10.42.42.2(pid=15542): stderr: | [0;m[1;31m20221210135030809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135030809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135030809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135030810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135030810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135030810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135030822 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135030838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135030838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135030838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:34.173993 run osmo-msc_10.42.42.6(pid=15548): ERR: Terminated: ERROR {rc=2} [trial-2375↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15548)] 13:50:34.223468 run osmo-msc_10.42.42.6(pid=15548): stdout: | (launched: 2022-12-10_13:50:33.043198) 13:50:34.275039 run osmo-msc_10.42.42.6(pid=15548): stderr: | [0;m[38;5;43m20221210135033366 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135033366 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f21a1088c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135033366 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135033366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135033366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135033366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135033368 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135033368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135033369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135033369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:50:34.327552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15541): Terminating (SIGTERM) 13:50:34.369148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15544): Terminating (SIGTERM) 13:50:34.410860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15547): Terminating (SIGTERM) 13:50:34.452813 --- ParallelTerminationStrategy: PID 15541 died... 13:50:34.472739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15541): Terminated: ok {rc=0} 13:50:34.519069 --- ParallelTerminationStrategy: PID 15544 died... 13:50:34.538597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15544): Terminated: ok {rc=0} 13:50:34.585409 --- ParallelTerminationStrategy: PID 15547 died... 13:50:34.604765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15547): Terminated: ok {rc=0} 13:50:34.692790 bus /sierra_3: Setting Powered False 13:50:35.790988 bus /sierra_3: Setting Powered False 13:50:36.909398 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 emergency:nanobts+band-900 --------------------------------------------------------------------- 13:50:38.159934 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:50:38.165071 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 13:50:38.196479 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 13:50:38.222342 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 13:50:38.306140 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 13:50:38.337992 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 13:50:38.363711 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 13:50:38.945354 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2375 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 13:50:38.950417 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:50:38.961270 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 13:50:39.007284 tst emergency_mo_mt_call.py: using LAC 28836 13:50:39.123603 tst emergency_mo_mt_call.py: using RAC 21 13:50:39.241058 tst emergency_mo_mt_call.py: using CellId 28836 13:50:39.356204 tst emergency_mo_mt_call.py: using BVCI 28837 13:50:39.469022 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:50:39.480171 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:50:39.491323 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:50:39.502598 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:50:39.513989 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:50:39.525230 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 13:50:39.640122 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 13:50:39.756250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:40.241881 run create_hlr_db(pid=15553): Launched 13:50:40.362773 bus /sierra_2: Setting Powered False 13:50:41.425057 run create_hlr_db(pid=15553): Terminated: ok {rc=0} 13:50:41.862100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15555): Launched 13:50:42.174692 run osmo-hlr_10.42.42.2(pid=15556): Launched 13:50:42.295091 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:42.834668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15558): Launched 13:50:43.147250 run osmo-stp_10.42.42.5(pid=15559): Launched 13:50:43.277184 tst emergency_mo_mt_call.py: using MSISDN 7763 13:50:43.437708 run osmo-msc_10.42.42.6: Starting osmo-msc 13:50:44.000044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15561): Launched 13:50:44.312900 run osmo-msc_10.42.42.6(pid=15562): Launched 13:50:44.489083 run osmo-stp_10.42.42.5(pid=15559): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15559)] 13:50:44.626838 run osmo-stp_10.42.42.5(pid=15559): stdout: | (launched: 2022-12-10_13:50:43.090387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:44.760543 run osmo-stp_10.42.42.5(pid=15559): stderr: | [0;m[38;5;43m20221210135043282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135043283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135043283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135043283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135043284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135043284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135043284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:44.893843 run osmo-stp_10.42.42.5(pid=15559): stdout: | (launched: 2022-12-10_13:50:43.090387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:45.018652 run osmo-stp_10.42.42.5(pid=15559): stderr: | [0;m[38;5;43m20221210135043282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135043283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135043283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135043283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135043284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135043284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135043284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:45.167561 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15559): Process ended prematurely: osmo-stp_10.42.42.5(pid=15559) [trial-2375↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15559)] [trial-2375↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 13:50:45.176536 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 13:50:45.203787 run osmo-hlr_10.42.42.2(pid=15556): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15556)] 13:50:45.254102 run osmo-hlr_10.42.42.2(pid=15556): stdout: | (launched: 2022-12-10_13:50:42.117746) 13:50:45.305893 run osmo-hlr_10.42.42.2(pid=15556): stderr: | [0;m[1;31m20221210135042314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135042314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135042314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135042314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135042314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135042314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135042370 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135042380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135042380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135042380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:45.377551 run osmo-msc_10.42.42.6(pid=15562): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15562)] 13:50:45.427340 run osmo-msc_10.42.42.6(pid=15562): stdout: | (launched: 2022-12-10_13:50:44.255366) 13:50:45.478759 run osmo-msc_10.42.42.6(pid=15562): stderr: | [0;m[38;5;43m20221210135044581 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135044581 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f19af4b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135044581 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135044581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135044582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135044582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135044584 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135044584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135044584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135044584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:50:45.530581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15555): Terminating (SIGTERM) 13:50:45.571891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15558): Terminating (SIGTERM) 13:50:45.613523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15561): Terminating (SIGTERM) 13:50:45.655456 --- ParallelTerminationStrategy: PID 15555 died... 13:50:45.675228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15555): Terminated: ok {rc=0} 13:50:45.721735 --- ParallelTerminationStrategy: PID 15558 died... 13:50:45.741245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15558): Terminated: ok {rc=0} 13:50:45.787305 --- ParallelTerminationStrategy: PID 15561 died... 13:50:45.806764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15561): Terminated: ok {rc=0} 13:50:45.911686 bus /sierra_3: Setting Powered False 13:50:47.026349 bus /sierra_3: Setting Powered False 13:50:48.140640 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 13:50:49.227322 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:50:49.239327 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 13:50:49.290472 tst emergency_preemptive_call.py: using LAC 28837 13:50:49.415083 tst emergency_preemptive_call.py: using RAC 22 13:50:49.540194 tst emergency_preemptive_call.py: using CellId 28837 13:50:49.663519 tst emergency_preemptive_call.py: using BVCI 28838 13:50:49.777577 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:50:49.788469 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:50:49.799290 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:50:49.810340 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:50:49.821455 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:50:49.832398 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 13:50:49.950201 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 13:50:50.063487 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 13:50:50.181261 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 13:50:50.296821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:50.753237 run create_hlr_db(pid=15564): Launched 13:50:50.873388 bus /sierra_2: Setting Powered False 13:50:51.933041 run create_hlr_db(pid=15564): Terminated: ok {rc=0} 13:50:52.362200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15566): Launched 13:50:52.676102 run osmo-hlr_10.42.42.2(pid=15567): Launched 13:50:52.795922 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:53.339340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15569): Launched 13:50:53.651131 run osmo-stp_10.42.42.5(pid=15570): Launched 13:50:53.781778 tst emergency_preemptive_call.py: using MSISDN 7764 13:50:53.941231 run osmo-msc_10.42.42.6: Starting osmo-msc 13:50:54.504567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15572): Launched 13:50:54.816225 run osmo-msc_10.42.42.6(pid=15573): Launched 13:50:54.991419 run osmo-stp_10.42.42.5(pid=15570): ERR: Terminated: ERROR {rc=1} [trial-2375↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15570)] 13:50:55.124428 run osmo-stp_10.42.42.5(pid=15570): stdout: | (launched: 2022-12-10_13:50:53.594250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:55.258006 run osmo-stp_10.42.42.5(pid=15570): stderr: | [0;m[38;5;43m20221210135053787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135053787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135053787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135053788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135053788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135053788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135053788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:55.391045 run osmo-stp_10.42.42.5(pid=15570): stdout: | (launched: 2022-12-10_13:50:53.594250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:55.515996 run osmo-stp_10.42.42.5(pid=15570): stderr: | [0;m[38;5;43m20221210135053787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135053787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135053787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135053788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135053788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135053788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135053788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:55.665059 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15570): Process ended prematurely: osmo-stp_10.42.42.5(pid=15570) [trial-2375↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15570)] [trial-2375↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 13:50:55.673749 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 13:50:55.701556 run osmo-hlr_10.42.42.2(pid=15567): ERR: Terminated: ERROR {rc=237} [trial-2375↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15567)] 13:50:55.751729 run osmo-hlr_10.42.42.2(pid=15567): stdout: | (launched: 2022-12-10_13:50:52.618827) 13:50:55.803449 run osmo-hlr_10.42.42.2(pid=15567): stderr: | [0;m[1;31m20221210135052817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135052817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135052817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135052817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135052817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135052817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135052831 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135052841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135052841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135052841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:55.875527 run osmo-msc_10.42.42.6(pid=15573): ERR: Terminated: ERROR {rc=2} [trial-2375↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15573)] 13:50:55.925382 run osmo-msc_10.42.42.6(pid=15573): stdout: | (launched: 2022-12-10_13:50:54.759433) 13:50:55.976906 run osmo-msc_10.42.42.6(pid=15573): stderr: | [0;m[38;5;43m20221210135055079 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135055079 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f406eabfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135055079 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135055079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135055079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135055079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135055081 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135055082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135055082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135055082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:50:56.028833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15566): Terminating (SIGTERM) 13:50:56.070644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15569): Terminating (SIGTERM) 13:50:56.112621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15572): Terminating (SIGTERM) 13:50:56.154800 --- ParallelTerminationStrategy: PID 15566 died... 13:50:56.174677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15566): Terminated: ok {rc=0} 13:50:56.221066 --- ParallelTerminationStrategy: PID 15569 died... 13:50:56.240422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15569): Terminated: ok {rc=0} 13:50:56.287153 --- ParallelTerminationStrategy: PID 15572 died... 13:50:56.306510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15572): Terminated: ok {rc=0} 13:50:56.394820 bus /sierra_9: Setting Powered False 13:50:57.492344 bus /sierra_9: Setting Powered False 13:50:58.606635 bus /sierra_8: Setting Powered False 13:50:59.703294 bus /sierra_8: Setting Powered False 13:51:00.818688 bus /sierra_3: Setting Powered False 13:51:01.927732 bus /sierra_3: Setting Powered False 13:51:03.060544 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-900 --------------------------------------------------------------------- 13:51:04.332678 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:51:04.337654 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 13:51:04.369042 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 13:51:04.406459 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 13:51:04.492601 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 13:51:04.525064 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 13:51:04.562977 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 13:51:05.150352 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 13:51:05.198497 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:05.209215 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 13:51:05.255908 tst cs_paging_gprs_active.py: using LAC 28838 13:51:05.374683 tst cs_paging_gprs_active.py: using RAC 23 13:51:05.493404 tst cs_paging_gprs_active.py: using CellId 28838 13:51:05.621761 tst cs_paging_gprs_active.py: using BVCI 28839 13:51:05.730996 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:05.741568 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:05.751893 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:05.762189 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:05.772367 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:05.782575 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:05.792887 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:05.803101 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:05.813523 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:51:05.930413 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:51:06.047198 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:51:06.247892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:06.548103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15578): Launched 13:51:06.825641 run iperf3-srv_10.42.42.10(pid=15579): Launched 13:51:06.946043 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:51:07.162280 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:07.483965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15580): Launched 13:51:07.760799 run iperf3-srv_10.42.42.10(pid=15581): Launched 13:51:07.880577 tst cs_paging_gprs_active.py:38: start network... 13:51:08.094532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:08.590450 run create_hlr_db(pid=15582): Launched 13:51:08.712849 bus /sierra_2: Setting Powered False 13:51:09.774943 run create_hlr_db(pid=15582): Terminated: ok {rc=0} 13:51:10.199815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15584): Launched 13:51:10.498875 run osmo-hlr_10.42.42.2(pid=15585): Launched 13:51:10.614031 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:11.143180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15587): Launched 13:51:11.441282 run osmo-stp_10.42.42.5(pid=15588): Launched 13:51:11.555441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:12.070382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15590): Launched 13:51:12.184803 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:12.437204 run patchelf(pid=15591): Launched 13:51:12.602919 run osmo-stp_10.42.42.5(pid=15588): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15588)] 13:51:12.728811 run osmo-stp_10.42.42.5(pid=15588): stdout: | (launched: 2022-12-10_13:51:11.386523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:12.855970 run osmo-stp_10.42.42.5(pid=15588): stderr: | [0;m[38;5;43m20221210135111556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135111556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135111556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135111557 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135111559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135111559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135111559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:12.983522 run osmo-stp_10.42.42.5(pid=15588): stdout: | (launched: 2022-12-10_13:51:11.386523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:13.105235 run osmo-stp_10.42.42.5(pid=15588): stderr: | [0;m[38;5;43m20221210135111556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135111556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135111556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135111557 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135111559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135111559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135111559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:13.249718 run patchelf(pid=15591): Terminating (SIGINT) 13:51:13.417220 run patchelf(pid=15591): Terminated: ok {rc=0} 13:51:13.538073 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15588): Process ended prematurely: osmo-stp_10.42.42.5(pid=15588) [trial-2375↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15588)] [trial-2375↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 13:51:13.547467 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 13:51:13.574054 run osmo-hlr_10.42.42.2(pid=15585): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15585)] 13:51:13.620554 run osmo-hlr_10.42.42.2(pid=15585): stdout: | (launched: 2022-12-10_13:51:10.444092) 13:51:13.668666 run osmo-hlr_10.42.42.2(pid=15585): stderr: | [0;m[1;31m20221210135110622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135110622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135110622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135110622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135110622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135110622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135110635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135110644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135110644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135110644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:13.717276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15578): Terminating (SIGTERM) 13:51:13.755975 run iperf3-srv_10.42.42.10(pid=15579): Terminating (SIGTERM) 13:51:13.794507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15580): Terminating (SIGTERM) 13:51:13.833126 run iperf3-srv_10.42.42.10(pid=15581): Terminating (SIGTERM) 13:51:13.871715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15584): Terminating (SIGTERM) 13:51:13.910375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15587): Terminating (SIGTERM) 13:51:13.949221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15590): Terminating (SIGTERM) 13:51:13.988162 --- ParallelTerminationStrategy: PID 15578 died... 13:51:14.006672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15578): Terminated: ok {rc=0} 13:51:14.049916 --- ParallelTerminationStrategy: PID 15579 died... 13:51:14.067845 run iperf3-srv_10.42.42.10(pid=15579): Terminated {rc=256} 13:51:14.111211 --- ParallelTerminationStrategy: PID 15580 died... 13:51:14.129396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15580): Terminated: ok {rc=0} 13:51:14.172054 --- ParallelTerminationStrategy: PID 15581 died... 13:51:14.190152 run iperf3-srv_10.42.42.10(pid=15581): Terminated {rc=256} 13:51:14.233214 --- ParallelTerminationStrategy: PID 15584 died... 13:51:14.251731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15584): Terminated: ok {rc=0} 13:51:14.295023 --- ParallelTerminationStrategy: PID 15587 died... 13:51:14.313123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15587): Terminated: ok {rc=0} 13:51:14.355772 --- ParallelTerminationStrategy: PID 15590 died... 13:51:14.374063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15590): Terminated: ok {rc=0} 13:51:14.458198 bus /gobi_0: Setting Powered False 13:51:15.556723 bus /gobi_0: Setting Powered False 13:51:16.669753 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 13:51:17.810423 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:17.821479 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 13:51:17.870890 tst iperf3.py: using LAC 28839 13:51:17.988423 tst iperf3.py: using RAC 24 13:51:18.110798 tst iperf3.py: using CellId 28839 13:51:18.228412 tst iperf3.py: using BVCI 28840 13:51:18.337180 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:18.347683 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:18.358412 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:18.368655 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:18.378887 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:18.388924 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:18.399322 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:18.409526 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:18.419843 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:51:18.536902 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:51:18.752570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:19.072304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15592): Launched 13:51:19.350032 run iperf3-srv_10.42.42.10(pid=15593): Launched 13:51:19.469547 tst iperf3.py:8: start network... 13:51:19.685215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:20.179849 run create_hlr_db(pid=15594): Launched 13:51:20.301665 bus /gobi_6: Setting Powered False 13:51:21.364325 run create_hlr_db(pid=15594): Terminated: ok {rc=0} 13:51:21.807822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15596): Launched 13:51:22.126867 run osmo-hlr_10.42.42.2(pid=15597): Launched 13:51:22.249217 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:22.804011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15599): Launched 13:51:23.122154 run osmo-stp_10.42.42.5(pid=15600): Launched 13:51:23.244425 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:23.794210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15602): Launched 13:51:23.915392 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:24.183838 run patchelf(pid=15603): Launched 13:51:24.360867 run osmo-stp_10.42.42.5(pid=15600): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15600)] 13:51:24.495260 run osmo-stp_10.42.42.5(pid=15600): stdout: | (launched: 2022-12-10_13:51:23.064298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:24.631736 run osmo-stp_10.42.42.5(pid=15600): stderr: | [0;m[38;5;43m20221210135123254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135123254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135123254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135123255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135123255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135123255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135123255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:24.768678 run osmo-stp_10.42.42.5(pid=15600): stdout: | (launched: 2022-12-10_13:51:23.064298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:24.899303 run osmo-stp_10.42.42.5(pid=15600): stderr: | [0;m[38;5;43m20221210135123254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135123254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135123254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135123255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135123255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135123255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135123255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:25.054410 run patchelf(pid=15603): Terminating (SIGINT) 13:51:25.233766 run patchelf(pid=15603): Terminated: ok {rc=0} 13:51:25.363224 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15600): Process ended prematurely: osmo-stp_10.42.42.5(pid=15600) [trial-2375↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15600)] [trial-2375↪gprs:nanobts+band-900↪iperf3.py:8] 13:51:25.373257 tst iperf3.py:8: Test FAILED (7.6 sec) 13:51:25.401800 run osmo-hlr_10.42.42.2(pid=15597): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15597)] 13:51:25.451326 run osmo-hlr_10.42.42.2(pid=15597): stdout: | (launched: 2022-12-10_13:51:22.068622) 13:51:25.502412 run osmo-hlr_10.42.42.2(pid=15597): stderr: | [0;m[1;31m20221210135122268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135122268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135122268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135122268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135122268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135122268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135122280 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135122289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135122289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135122289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:25.553973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15592): Terminating (SIGTERM) 13:51:25.595205 run iperf3-srv_10.42.42.10(pid=15593): Terminating (SIGTERM) 13:51:25.636200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15596): Terminating (SIGTERM) 13:51:25.677556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15599): Terminating (SIGTERM) 13:51:25.718669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15602): Terminating (SIGTERM) 13:51:25.759982 --- ParallelTerminationStrategy: PID 15592 died... 13:51:25.779528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15592): Terminated: ok {rc=0} 13:51:25.825553 --- ParallelTerminationStrategy: PID 15593 died... 13:51:25.844664 run iperf3-srv_10.42.42.10(pid=15593): Terminated {rc=256} 13:51:25.890606 --- ParallelTerminationStrategy: PID 15596 died... 13:51:25.909825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15596): Terminated: ok {rc=0} 13:51:25.955494 --- ParallelTerminationStrategy: PID 15599 died... 13:51:25.974731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15599): Terminated: ok {rc=0} 13:51:26.020562 --- ParallelTerminationStrategy: PID 15602 died... 13:51:26.039761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15602): Terminated: ok {rc=0} 13:51:26.126551 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 13:51:27.274054 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:27.288863 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 13:51:27.334723 tst iperf3m4.py: using LAC 28840 13:51:27.461710 tst iperf3m4.py: using RAC 25 13:51:27.581088 tst iperf3m4.py: using CellId 28840 13:51:27.699023 tst iperf3m4.py: using BVCI 28841 13:51:27.807186 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:27.817794 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:27.828257 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:27.838725 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:27.849218 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:27.859419 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:27.869885 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:27.880019 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:27.890555 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:51:28.007797 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:51:28.125729 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:51:28.245421 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:51:28.366675 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:51:28.582066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:28.901956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15604): Launched 13:51:29.178327 run iperf3-srv_10.42.42.10(pid=15605): Launched 13:51:29.297879 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:51:29.512153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:29.830434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15606): Launched 13:51:30.106226 run iperf3-srv_10.42.42.10(pid=15607): Launched 13:51:30.225570 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:51:30.440801 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:30.760433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15608): Launched 13:51:31.066459 run iperf3-srv_10.42.42.10(pid=15609): Launched 13:51:31.201129 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:51:31.420722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:31.758716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15610): Launched 13:51:32.050450 run iperf3-srv_10.42.42.10(pid=15611): Launched 13:51:32.184413 tst iperf3m4.py:8: start network... 13:51:32.400020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:32.895326 run create_hlr_db(pid=15612): Launched 13:51:33.016225 bus /gobi_6: Setting Powered False 13:51:34.079834 run create_hlr_db(pid=15612): Terminated: ok {rc=0} 13:51:34.523888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15614): Launched 13:51:34.843878 run osmo-hlr_10.42.42.2(pid=15615): Launched 13:51:34.966658 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:35.521443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15617): Launched 13:51:35.841411 run osmo-stp_10.42.42.5(pid=15618): Launched 13:51:35.963799 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:36.516728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15620): Launched 13:51:36.638282 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:36.908090 run patchelf(pid=15621): Launched 13:51:37.085429 run osmo-stp_10.42.42.5(pid=15618): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15618)] 13:51:37.220521 run osmo-stp_10.42.42.5(pid=15618): stdout: | (launched: 2022-12-10_13:51:35.782549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:37.358052 run osmo-stp_10.42.42.5(pid=15618): stderr: | [0;m[38;5;43m20221210135135975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135135975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135135975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135135976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135135978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135135978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135135978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:37.495487 run osmo-stp_10.42.42.5(pid=15618): stdout: | (launched: 2022-12-10_13:51:35.782549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:37.627709 run osmo-stp_10.42.42.5(pid=15618): stderr: | [0;m[38;5;43m20221210135135975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135135975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135135975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135135976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135135978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135135978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135135978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:37.783344 run patchelf(pid=15621): Terminating (SIGINT) 13:51:37.962403 run patchelf(pid=15621): Terminated: ok {rc=0} 13:51:38.091273 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15618): Process ended prematurely: osmo-stp_10.42.42.5(pid=15618) [trial-2375↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15618)] [trial-2375↪gprs:nanobts+band-900↪iperf3m4.py:8] 13:51:38.101274 tst iperf3m4.py:8: Test FAILED (10.9 sec) 13:51:38.130475 run osmo-hlr_10.42.42.2(pid=15615): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15615)] 13:51:38.180275 run osmo-hlr_10.42.42.2(pid=15615): stdout: | (launched: 2022-12-10_13:51:34.785157) 13:51:38.231984 run osmo-hlr_10.42.42.2(pid=15615): stderr: | [0;m[1;31m20221210135134984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135134984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135134984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135134984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135134984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135134984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135135005 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135135015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135135015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135135015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:38.284088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15604): Terminating (SIGTERM) 13:51:38.325905 run iperf3-srv_10.42.42.10(pid=15605): Terminating (SIGTERM) 13:51:38.367387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15606): Terminating (SIGTERM) 13:51:38.408898 run iperf3-srv_10.42.42.10(pid=15607): Terminating (SIGTERM) 13:51:38.450546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15608): Terminating (SIGTERM) 13:51:38.491991 run iperf3-srv_10.42.42.10(pid=15609): Terminating (SIGTERM) 13:51:38.533552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15610): Terminating (SIGTERM) 13:51:38.574875 run iperf3-srv_10.42.42.10(pid=15611): Terminating (SIGTERM) 13:51:38.616231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15614): Terminating (SIGTERM) 13:51:38.657660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15617): Terminating (SIGTERM) 13:51:38.699007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15620): Terminating (SIGTERM) 13:51:38.740659 --- ParallelTerminationStrategy: PID 15604 died... 13:51:38.760494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15604): Terminated: ok {rc=0} 13:51:38.806862 --- ParallelTerminationStrategy: PID 15605 died... 13:51:38.826195 run iperf3-srv_10.42.42.10(pid=15605): Terminated {rc=256} 13:51:38.871943 --- ParallelTerminationStrategy: PID 15606 died... 13:51:38.891111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15606): Terminated: ok {rc=0} 13:51:38.936708 --- ParallelTerminationStrategy: PID 15607 died... 13:51:38.956001 run iperf3-srv_10.42.42.10(pid=15607): Terminated {rc=256} 13:51:39.001748 --- ParallelTerminationStrategy: PID 15608 died... 13:51:39.021013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15608): Terminated: ok {rc=0} 13:51:39.067308 --- ParallelTerminationStrategy: PID 15609 died... 13:51:39.086543 run iperf3-srv_10.42.42.10(pid=15609): Terminated {rc=256} 13:51:39.132357 --- ParallelTerminationStrategy: PID 15610 died... 13:51:39.151753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15610): Terminated: ok {rc=0} 13:51:39.197547 --- ParallelTerminationStrategy: PID 15611 died... 13:51:39.216558 run iperf3-srv_10.42.42.10(pid=15611): Terminated {rc=256} 13:51:39.262582 --- ParallelTerminationStrategy: PID 15614 died... 13:51:39.281884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15614): Terminated: ok {rc=0} 13:51:39.328011 --- ParallelTerminationStrategy: PID 15617 died... 13:51:39.347535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15617): Terminated: ok {rc=0} 13:51:39.393516 --- ParallelTerminationStrategy: PID 15620 died... 13:51:39.412698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15620): Terminated: ok {rc=0} 13:51:39.498519 bus /gobi_4: Setting Powered False 13:51:40.594938 bus /gobi_4: Setting Powered False 13:51:41.709838 bus /gobi_1: Setting Powered False 13:51:42.807485 bus /gobi_1: Setting Powered False 13:51:43.920785 bus /gobi_0: Setting Powered False 13:51:45.017592 bus /gobi_0: Setting Powered False 13:51:46.132379 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900 ping.py ---------------------------------------------- 13:51:47.254553 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:47.266757 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 13:51:47.316148 tst ping.py: using LAC 28841 13:51:47.442001 tst ping.py: using RAC 26 13:51:47.567010 tst ping.py: using CellId 28841 13:51:47.690708 tst ping.py: using BVCI 28842 13:51:47.805441 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:47.816319 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:47.827252 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:47.838316 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:47.849439 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:47.860370 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:47.871539 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:47.882665 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:51:47.997123 tst ping.py:19: start network... 13:51:48.193057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:48.646000 run create_hlr_db(pid=15622): Launched 13:51:48.765355 bus /gobi_6: Setting Powered False 13:51:49.824257 run create_hlr_db(pid=15622): Terminated: ok {rc=0} 13:51:50.252173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15624): Launched 13:51:50.552115 run osmo-hlr_10.42.42.2(pid=15625): Launched 13:51:50.674300 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:51.217669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15627): Launched 13:51:51.531399 run osmo-stp_10.42.42.5(pid=15628): Launched 13:51:51.650938 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:52.191981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15630): Launched 13:51:52.312492 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:52.577658 run patchelf(pid=15631): Launched 13:51:52.753062 run osmo-stp_10.42.42.5(pid=15628): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15628)] 13:51:52.886542 run osmo-stp_10.42.42.5(pid=15628): stdout: | (launched: 2022-12-10_13:51:51.474241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:53.021822 run osmo-stp_10.42.42.5(pid=15628): stderr: | [0;m[38;5;43m20221210135151668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135151668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135151668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135151669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135151669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135151669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135151669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:53.156803 run osmo-stp_10.42.42.5(pid=15628): stdout: | (launched: 2022-12-10_13:51:51.474241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:53.286357 run osmo-stp_10.42.42.5(pid=15628): stderr: | [0;m[38;5;43m20221210135151668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135151668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135151668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135151669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135151669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135151669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135151669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:53.440424 run patchelf(pid=15631): Terminating (SIGINT) 13:51:53.618274 run patchelf(pid=15631): Terminated: ok {rc=0} 13:51:53.745953 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15628): Process ended prematurely: osmo-stp_10.42.42.5(pid=15628) [trial-2375↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15628)] [trial-2375↪gprs:nanobts+band-900↪ping.py:22] 13:51:53.755370 tst ping.py:22: Test FAILED (6.5 sec) 13:51:53.783527 run osmo-hlr_10.42.42.2(pid=15625): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15625)] 13:51:53.833490 run osmo-hlr_10.42.42.2(pid=15625): stdout: | (launched: 2022-12-10_13:51:50.498232) 13:51:53.884648 run osmo-hlr_10.42.42.2(pid=15625): stderr: | [0;m[1;31m20221210135150688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135150688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135150688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135150688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135150688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135150688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135150701 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135150709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135150709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135150709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:53.936260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15624): Terminating (SIGTERM) 13:51:53.977839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15627): Terminating (SIGTERM) 13:51:54.019364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15630): Terminating (SIGTERM) 13:51:54.061255 --- ParallelTerminationStrategy: PID 15624 died... 13:51:54.080737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15624): Terminated: ok {rc=0} 13:51:54.127149 --- ParallelTerminationStrategy: PID 15627 died... 13:51:54.146545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15627): Terminated: ok {rc=0} 13:51:54.192413 --- ParallelTerminationStrategy: PID 15630 died... 13:51:54.211747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15630): Terminated: ok {rc=0} 13:51:54.298582 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 13:51:55.384364 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:55.395621 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 13:51:55.443420 tst ping_idle_ping.py: using LAC 28842 13:51:55.561335 tst ping_idle_ping.py: using RAC 27 13:51:55.677043 tst ping_idle_ping.py: using CellId 28842 13:51:55.792818 tst ping_idle_ping.py: using BVCI 28843 13:51:55.899526 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:55.910122 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:55.920517 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:55.930958 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:55.941230 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:55.951500 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:55.961946 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:51:55.972258 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:51:56.088830 tst ping_idle_ping.py:24: start network... 13:51:56.300015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:56.788656 run create_hlr_db(pid=15632): Launched 13:51:56.909224 bus /gobi_6: Setting Powered False 13:51:57.971575 run create_hlr_db(pid=15632): Terminated: ok {rc=0} 13:51:58.392657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15634): Launched 13:51:58.686973 run osmo-hlr_10.42.42.2(pid=15635): Launched 13:51:58.798330 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:59.303352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15637): Launched 13:51:59.597258 run osmo-stp_10.42.42.5(pid=15638): Launched 13:51:59.709364 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:00.215905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15640): Launched 13:52:00.328091 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:00.577154 run patchelf(pid=15641): Launched 13:52:00.740776 run osmo-stp_10.42.42.5(pid=15638): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15638)] 13:52:00.870726 run osmo-stp_10.42.42.5(pid=15638): stdout: | (launched: 2022-12-10_13:51:59.543206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:01.021759 run osmo-stp_10.42.42.5(pid=15638): stderr: | [0;m[38;5;43m20221210135159712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135159713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135159713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135159713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135159714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135159714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135159714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:01.153265 run osmo-stp_10.42.42.5(pid=15638): stdout: | (launched: 2022-12-10_13:51:59.543206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:01.278001 run osmo-stp_10.42.42.5(pid=15638): stderr: | [0;m[38;5;43m20221210135159712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135159713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135159713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135159713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135159714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135159714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135159714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:01.427537 run patchelf(pid=15641): Terminating (SIGINT) 13:52:01.598769 run patchelf(pid=15641): Terminated: ok {rc=0} 13:52:01.721439 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15638): Process ended prematurely: osmo-stp_10.42.42.5(pid=15638) [trial-2375↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15638)] [trial-2375↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 13:52:01.730892 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 13:52:01.758529 run osmo-hlr_10.42.42.2(pid=15635): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15635)] 13:52:01.807176 run osmo-hlr_10.42.42.2(pid=15635): stdout: | (launched: 2022-12-10_13:51:58.632910) 13:52:01.857667 run osmo-hlr_10.42.42.2(pid=15635): stderr: | [0;m[1;31m20221210135158809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135158809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135158809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135158809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135158809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135158809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135158824 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135158832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135158833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135158833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:01.908376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15634): Terminating (SIGTERM) 13:52:01.948591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15637): Terminating (SIGTERM) 13:52:01.988886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15640): Terminating (SIGTERM) 13:52:02.029399 --- ParallelTerminationStrategy: PID 15634 died... 13:52:02.048645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15634): Terminated: ok {rc=0} 13:52:02.093680 --- ParallelTerminationStrategy: PID 15637 died... 13:52:02.112709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15637): Terminated: ok {rc=0} 13:52:02.157343 --- ParallelTerminationStrategy: PID 15640 died... 13:52:02.176235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15640): Terminated: ok {rc=0} 13:52:02.259867 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 13:52:03.559973 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:52:03.566855 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:52:03.601265 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:52:03.640448 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:52:03.728899 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:52:03.762126 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:52:03.801653 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:52:04.400937 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:52:04.453641 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:04.464714 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:52:04.516323 tst cs_paging_gprs_active.py: using LAC 28843 13:52:04.642737 tst cs_paging_gprs_active.py: using RAC 28 13:52:04.768519 tst cs_paging_gprs_active.py: using CellId 28843 13:52:04.897979 tst cs_paging_gprs_active.py: using BVCI 28844 13:52:05.016661 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:05.027997 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:05.038999 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:05.050404 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:05.061537 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:05.072681 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:05.084013 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:05.094984 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:05.106407 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:52:05.223346 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:52:05.341519 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:52:05.558088 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:05.878705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15646): Launched 13:52:06.157102 run iperf3-srv_10.42.42.10(pid=15647): Launched 13:52:06.277056 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:52:06.492339 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:06.812622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15648): Launched 13:52:07.090221 run iperf3-srv_10.42.42.10(pid=15649): Launched 13:52:07.209547 tst cs_paging_gprs_active.py:38: start network... 13:52:07.424426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:07.918235 run create_hlr_db(pid=15650): Launched 13:52:08.038807 bus /gobi_6: Setting Powered False 13:52:09.101943 run create_hlr_db(pid=15650): Terminated: ok {rc=0} 13:52:09.528426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15652): Launched 13:52:09.828765 run osmo-hlr_10.42.42.2(pid=15653): Launched 13:52:09.942950 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:10.470721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15655): Launched 13:52:10.769442 run osmo-stp_10.42.42.5(pid=15656): Launched 13:52:10.883438 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:11.402579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15658): Launched 13:52:11.516272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:11.769586 run patchelf(pid=15659): Launched 13:52:11.936518 run osmo-stp_10.42.42.5(pid=15656): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15656)] 13:52:12.063283 run osmo-stp_10.42.42.5(pid=15656): stdout: | (launched: 2022-12-10_13:52:10.714689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:12.191639 run osmo-stp_10.42.42.5(pid=15656): stderr: | [0;m[38;5;43m20221210135210882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135210883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135210883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135210884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135210886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135210886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135210886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:12.320042 run osmo-stp_10.42.42.5(pid=15656): stdout: | (launched: 2022-12-10_13:52:10.714689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:12.443021 run osmo-stp_10.42.42.5(pid=15656): stderr: | [0;m[38;5;43m20221210135210882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135210883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135210883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135210884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135210886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135210886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135210886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:12.588785 run patchelf(pid=15659): Terminating (SIGINT) 13:52:12.757174 run patchelf(pid=15659): Terminated: ok {rc=0} 13:52:12.878452 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15656): Process ended prematurely: osmo-stp_10.42.42.5(pid=15656) [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15656)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:52:12.887729 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:52:12.914442 run osmo-hlr_10.42.42.2(pid=15653): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15653)] 13:52:12.961425 run osmo-hlr_10.42.42.2(pid=15653): stdout: | (launched: 2022-12-10_13:52:09.774030) 13:52:13.010060 run osmo-hlr_10.42.42.2(pid=15653): stderr: | [0;m[1;31m20221210135209947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135209947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135209947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135209947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135209947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135209947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135209961 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135209970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135209970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135209970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:13.059154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15646): Terminating (SIGTERM) 13:52:13.099159 run iperf3-srv_10.42.42.10(pid=15647): Terminating (SIGTERM) 13:52:13.138141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15648): Terminating (SIGTERM) 13:52:13.177035 run iperf3-srv_10.42.42.10(pid=15649): Terminating (SIGTERM) 13:52:13.215994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15652): Terminating (SIGTERM) 13:52:13.255070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15655): Terminating (SIGTERM) 13:52:13.294221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15658): Terminating (SIGTERM) 13:52:13.333801 --- ParallelTerminationStrategy: PID 15646 died... 13:52:13.352629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15646): Terminated: ok {rc=0} 13:52:13.396022 --- ParallelTerminationStrategy: PID 15647 died... 13:52:13.414503 run iperf3-srv_10.42.42.10(pid=15647): Terminated {rc=256} 13:52:13.457561 --- ParallelTerminationStrategy: PID 15648 died... 13:52:13.476066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15648): Terminated: ok {rc=0} 13:52:13.519310 --- ParallelTerminationStrategy: PID 15649 died... 13:52:13.537751 run iperf3-srv_10.42.42.10(pid=15649): Terminated {rc=256} 13:52:13.580793 --- ParallelTerminationStrategy: PID 15652 died... 13:52:13.599339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15652): Terminated: ok {rc=0} 13:52:13.642483 --- ParallelTerminationStrategy: PID 15655 died... 13:52:13.660827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15655): Terminated: ok {rc=0} 13:52:13.704036 --- ParallelTerminationStrategy: PID 15658 died... 13:52:13.722545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15658): Terminated: ok {rc=0} 13:52:13.806048 bus /gobi_0: Setting Powered False 13:52:14.904356 bus /gobi_0: Setting Powered False 13:52:16.015014 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:52:17.164109 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:17.177027 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:52:17.229172 tst iperf3.py: using LAC 28844 13:52:17.359223 tst iperf3.py: using RAC 29 13:52:17.477307 tst iperf3.py: using CellId 28844 13:52:17.593642 tst iperf3.py: using BVCI 28845 13:52:17.702270 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:17.713509 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:17.724247 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:17.734810 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:17.745542 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:17.755968 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:17.766625 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:17.777130 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:17.787723 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:52:17.900731 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:52:18.101543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:18.400395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15660): Launched 13:52:18.659713 run iperf3-srv_10.42.42.10(pid=15661): Launched 13:52:18.771520 tst iperf3.py:8: start network... 13:52:18.971184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:19.435418 run create_hlr_db(pid=15662): Launched 13:52:19.557590 bus /gobi_6: Setting Powered False 13:52:20.616777 run create_hlr_db(pid=15662): Terminated: ok {rc=0} 13:52:21.051767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15664): Launched 13:52:21.355845 run osmo-hlr_10.42.42.2(pid=15665): Launched 13:52:21.470099 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:21.986893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15667): Launched 13:52:22.284501 run osmo-stp_10.42.42.5(pid=15668): Launched 13:52:22.398247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:22.914821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15670): Launched 13:52:23.027999 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:23.281268 run patchelf(pid=15671): Launched 13:52:23.447122 run osmo-stp_10.42.42.5(pid=15668): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15668)] 13:52:23.573501 run osmo-stp_10.42.42.5(pid=15668): stdout: | (launched: 2022-12-10_13:52:22.229929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:23.700835 run osmo-stp_10.42.42.5(pid=15668): stderr: | [0;m[38;5;43m20221210135222402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135222403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135222403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135222403 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135222404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135222404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135222404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:23.828636 run osmo-stp_10.42.42.5(pid=15668): stdout: | (launched: 2022-12-10_13:52:22.229929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:23.950724 run osmo-stp_10.42.42.5(pid=15668): stderr: | [0;m[38;5;43m20221210135222402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135222403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135222403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135222403 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135222404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135222404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135222404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:24.095320 run patchelf(pid=15671): Terminating (SIGINT) 13:52:24.263199 run patchelf(pid=15671): Terminated: ok {rc=0} 13:52:24.383949 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15668): Process ended prematurely: osmo-stp_10.42.42.5(pid=15668) [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15668)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 13:52:24.393369 tst iperf3.py:8: Test FAILED (7.3 sec) 13:52:24.420114 run osmo-hlr_10.42.42.2(pid=15665): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15665)] 13:52:24.467396 run osmo-hlr_10.42.42.2(pid=15665): stdout: | (launched: 2022-12-10_13:52:21.301076) 13:52:24.515772 run osmo-hlr_10.42.42.2(pid=15665): stderr: | [0;m[1;31m20221210135221475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135221475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135221475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135221475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135221475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135221475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135221490 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135221499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135221499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135221499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:24.564609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15660): Terminating (SIGTERM) 13:52:24.603251 run iperf3-srv_10.42.42.10(pid=15661): Terminating (SIGTERM) 13:52:24.642054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15664): Terminating (SIGTERM) 13:52:24.680664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15667): Terminating (SIGTERM) 13:52:24.719311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15670): Terminating (SIGTERM) 13:52:24.758360 --- ParallelTerminationStrategy: PID 15660 died... 13:52:24.776724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15660): Terminated: ok {rc=0} 13:52:24.819748 --- ParallelTerminationStrategy: PID 15661 died... 13:52:24.838061 run iperf3-srv_10.42.42.10(pid=15661): Terminated {rc=256} 13:52:24.881095 --- ParallelTerminationStrategy: PID 15664 died... 13:52:24.899457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15664): Terminated: ok {rc=0} 13:52:24.942538 --- ParallelTerminationStrategy: PID 15667 died... 13:52:24.960930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15667): Terminated: ok {rc=0} 13:52:25.003978 --- ParallelTerminationStrategy: PID 15670 died... 13:52:25.022303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15670): Terminated: ok {rc=0} 13:52:25.105655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:52:26.250546 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:26.262020 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:52:26.310671 tst iperf3m4.py: using LAC 28845 13:52:26.433597 tst iperf3m4.py: using RAC 30 13:52:26.551247 tst iperf3m4.py: using CellId 28845 13:52:26.667246 tst iperf3m4.py: using BVCI 28846 13:52:26.776236 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:26.787074 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:26.797726 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:26.808306 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:26.818839 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:26.829456 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:26.840170 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:26.850645 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:26.861473 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:52:26.980140 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:52:27.102170 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:52:27.219400 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:52:27.340370 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:52:27.557393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:27.877542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15672): Launched 13:52:28.156620 run iperf3-srv_10.42.42.10(pid=15673): Launched 13:52:28.276692 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:52:28.493333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:28.813428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15674): Launched 13:52:29.091995 run iperf3-srv_10.42.42.10(pid=15675): Launched 13:52:29.211923 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:52:29.428568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:29.750072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15676): Launched 13:52:30.029077 run iperf3-srv_10.42.42.10(pid=15677): Launched 13:52:30.148918 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:52:30.365293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:30.686549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15678): Launched 13:52:30.981711 run iperf3-srv_10.42.42.10(pid=15679): Launched 13:52:31.108239 tst iperf3m4.py:8: start network... 13:52:31.329504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:31.911937 run create_hlr_db(pid=15680): Launched 13:52:32.053020 bus /gobi_6: Setting Powered False 13:52:33.115970 run create_hlr_db(pid=15680): Terminated: ok {rc=0} 13:52:33.543321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15682): Launched 13:52:33.843224 run osmo-hlr_10.42.42.2(pid=15683): Launched 13:52:33.956525 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:34.485733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15685): Launched 13:52:34.784753 run osmo-stp_10.42.42.5(pid=15686): Launched 13:52:34.898520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:35.414228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15688): Launched 13:52:35.527692 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:35.780807 run patchelf(pid=15689): Launched 13:52:35.946972 run osmo-stp_10.42.42.5(pid=15686): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15686)] 13:52:36.075842 run osmo-stp_10.42.42.5(pid=15686): stdout: | (launched: 2022-12-10_13:52:34.729540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:36.203723 run osmo-stp_10.42.42.5(pid=15686): stderr: | [0;m[38;5;43m20221210135234899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135234900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135234900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135234900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135234901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135234901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135234901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:36.331552 run osmo-stp_10.42.42.5(pid=15686): stdout: | (launched: 2022-12-10_13:52:34.729540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:36.454219 run osmo-stp_10.42.42.5(pid=15686): stderr: | [0;m[38;5;43m20221210135234899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135234900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135234900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135234900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135234901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135234901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135234901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:36.599337 run patchelf(pid=15689): Terminating (SIGINT) 13:52:36.767334 run patchelf(pid=15689): Terminated: ok {rc=0} 13:52:36.888346 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15686): Process ended prematurely: osmo-stp_10.42.42.5(pid=15686) [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15686)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 13:52:36.897922 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:52:36.925430 run osmo-hlr_10.42.42.2(pid=15683): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15683)] 13:52:36.972836 run osmo-hlr_10.42.42.2(pid=15683): stdout: | (launched: 2022-12-10_13:52:33.788018) 13:52:37.021841 run osmo-hlr_10.42.42.2(pid=15683): stderr: | [0;m[1;31m20221210135233962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135233962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135233962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135233962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135233962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135233963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135233975 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135233986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135233986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135233986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:37.071479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15672): Terminating (SIGTERM) 13:52:37.111177 run iperf3-srv_10.42.42.10(pid=15673): Terminating (SIGTERM) 13:52:37.150616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15674): Terminating (SIGTERM) 13:52:37.190439 run iperf3-srv_10.42.42.10(pid=15675): Terminating (SIGTERM) 13:52:37.230066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15676): Terminating (SIGTERM) 13:52:37.269973 run iperf3-srv_10.42.42.10(pid=15677): Terminating (SIGTERM) 13:52:37.309535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15678): Terminating (SIGTERM) 13:52:37.349681 run iperf3-srv_10.42.42.10(pid=15679): Terminating (SIGTERM) 13:52:37.389377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15682): Terminating (SIGTERM) 13:52:37.429204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15685): Terminating (SIGTERM) 13:52:37.468641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15688): Terminating (SIGTERM) 13:52:37.508377 --- ParallelTerminationStrategy: PID 15672 died... 13:52:37.527519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15672): Terminated: ok {rc=0} 13:52:37.571574 --- ParallelTerminationStrategy: PID 15673 died... 13:52:37.590248 run iperf3-srv_10.42.42.10(pid=15673): Terminated {rc=256} 13:52:37.633970 --- ParallelTerminationStrategy: PID 15674 died... 13:52:37.652249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15674): Terminated: ok {rc=0} 13:52:37.695837 --- ParallelTerminationStrategy: PID 15675 died... 13:52:37.714073 run iperf3-srv_10.42.42.10(pid=15675): Terminated {rc=256} 13:52:37.756832 --- ParallelTerminationStrategy: PID 15676 died... 13:52:37.775460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15676): Terminated: ok {rc=0} 13:52:37.818493 --- ParallelTerminationStrategy: PID 15677 died... 13:52:37.837236 run iperf3-srv_10.42.42.10(pid=15677): Terminated {rc=256} 13:52:37.880190 --- ParallelTerminationStrategy: PID 15678 died... 13:52:37.898575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15678): Terminated: ok {rc=0} 13:52:37.941567 --- ParallelTerminationStrategy: PID 15679 died... 13:52:37.959798 run iperf3-srv_10.42.42.10(pid=15679): Terminated {rc=256} 13:52:38.002756 --- ParallelTerminationStrategy: PID 15682 died... 13:52:38.021028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15682): Terminated: ok {rc=0} 13:52:38.063834 --- ParallelTerminationStrategy: PID 15685 died... 13:52:38.082226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15685): Terminated: ok {rc=0} 13:52:38.125564 --- ParallelTerminationStrategy: PID 15688 died... 13:52:38.144137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15688): Terminated: ok {rc=0} 13:52:38.229336 bus /gobi_4: Setting Powered False 13:52:39.328196 bus /gobi_4: Setting Powered False 13:52:40.441895 bus /gobi_1: Setting Powered False 13:52:41.540030 bus /gobi_1: Setting Powered False 13:52:42.653039 bus /gobi_0: Setting Powered False 13:52:43.751735 bus /gobi_0: Setting Powered False 13:52:44.865975 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 13:52:45.968642 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:45.981569 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:52:46.040357 tst ping.py: using LAC 28846 13:52:46.166601 tst ping.py: using RAC 31 13:52:46.296045 tst ping.py: using CellId 28846 13:52:46.412474 tst ping.py: using BVCI 28847 13:52:46.521658 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:46.532571 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:46.543391 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:46.555139 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:46.566956 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:46.578532 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:46.590067 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:46.601233 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:52:46.732110 tst ping.py:19: start network... 13:52:47.005617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:47.513179 run create_hlr_db(pid=15691): Launched 13:52:47.633440 bus /gobi_6: Setting Powered False 13:52:48.692227 run create_hlr_db(pid=15691): Terminated: ok {rc=0} 13:52:49.102317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15693): Launched 13:52:49.396302 run osmo-hlr_10.42.42.2(pid=15694): Launched 13:52:49.507519 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:50.014997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15696): Launched 13:52:50.309079 run osmo-stp_10.42.42.5(pid=15697): Launched 13:52:50.421253 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:50.947122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15699): Launched 13:52:51.059435 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:51.308246 run patchelf(pid=15700): Launched 13:52:51.473862 run osmo-stp_10.42.42.5(pid=15697): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15697)] 13:52:51.599051 run osmo-stp_10.42.42.5(pid=15697): stdout: | (launched: 2022-12-10_13:52:50.254703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:51.725505 run osmo-stp_10.42.42.5(pid=15697): stderr: | [0;m[38;5;43m20221210135250425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135250425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135250425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135250426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135250426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135250426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135250426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:51.852517 run osmo-stp_10.42.42.5(pid=15697): stdout: | (launched: 2022-12-10_13:52:50.254703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:51.974385 run osmo-stp_10.42.42.5(pid=15697): stderr: | [0;m[38;5;43m20221210135250425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135250425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135250425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135250426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135250426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135250426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135250426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:52.118526 run patchelf(pid=15700): Terminating (SIGINT) 13:52:52.285313 run patchelf(pid=15700): Terminated: ok {rc=0} 13:52:52.405076 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15697): Process ended prematurely: osmo-stp_10.42.42.5(pid=15697) [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15697)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 13:52:52.413833 tst ping.py:22: Test FAILED (6.4 sec) 13:52:52.440479 run osmo-hlr_10.42.42.2(pid=15694): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15694)] 13:52:52.487375 run osmo-hlr_10.42.42.2(pid=15694): stdout: | (launched: 2022-12-10_13:52:49.341325) 13:52:52.540257 run osmo-hlr_10.42.42.2(pid=15694): stderr: | [0;m[1;31m20221210135249516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135249516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135249516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135249516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135249516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135249516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135249528 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135249537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135249538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135249538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:52.592265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15693): Terminating (SIGTERM) 13:52:52.633525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15696): Terminating (SIGTERM) 13:52:52.674891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15699): Terminating (SIGTERM) 13:52:52.716704 --- ParallelTerminationStrategy: PID 15693 died... 13:52:52.736436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15693): Terminated: ok {rc=0} 13:52:52.782661 --- ParallelTerminationStrategy: PID 15696 died... 13:52:52.802053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15696): Terminated: ok {rc=0} 13:52:52.847911 --- ParallelTerminationStrategy: PID 15699 died... 13:52:52.867289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15699): Terminated: ok {rc=0} 13:52:52.953917 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:52:54.040288 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:54.052250 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:52:54.103414 tst ping_idle_ping.py: using LAC 28847 13:52:54.220753 tst ping_idle_ping.py: using RAC 32 13:52:54.336461 tst ping_idle_ping.py: using CellId 28847 13:52:54.453049 tst ping_idle_ping.py: using BVCI 28848 13:52:54.560154 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:54.571344 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:54.582009 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:54.592502 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:54.603052 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:54.613826 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:54.624532 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:52:54.635044 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:52:54.753283 tst ping_idle_ping.py:24: start network... 13:52:54.965439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:55.455234 run create_hlr_db(pid=15701): Launched 13:52:55.576252 bus /gobi_6: Setting Powered False 13:52:56.639589 run create_hlr_db(pid=15701): Terminated: ok {rc=0} 13:52:57.061249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15703): Launched 13:52:57.356700 run osmo-hlr_10.42.42.2(pid=15704): Launched 13:52:57.469531 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:57.993281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15706): Launched 13:52:58.287688 run osmo-stp_10.42.42.5(pid=15707): Launched 13:52:58.399732 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:58.909161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15709): Launched 13:52:59.021827 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:59.271212 run patchelf(pid=15710): Launched 13:52:59.436085 run osmo-stp_10.42.42.5(pid=15707): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15707)] 13:52:59.560728 run osmo-stp_10.42.42.5(pid=15707): stdout: | (launched: 2022-12-10_13:52:58.233419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:59.687034 run osmo-stp_10.42.42.5(pid=15707): stderr: | [0;m[38;5;43m20221210135258402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135258402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135258403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135258403 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135258403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135258404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135258404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:59.812851 run osmo-stp_10.42.42.5(pid=15707): stdout: | (launched: 2022-12-10_13:52:58.233419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:59.933699 run osmo-stp_10.42.42.5(pid=15707): stderr: | [0;m[38;5;43m20221210135258402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135258402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135258403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135258403 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135258403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135258404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135258404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:00.076786 run patchelf(pid=15710): Terminating (SIGINT) 13:53:00.243752 run patchelf(pid=15710): Terminated: ok {rc=0} 13:53:00.363267 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15707): Process ended prematurely: osmo-stp_10.42.42.5(pid=15707) [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15707)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 13:53:00.371997 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 13:53:00.398568 run osmo-hlr_10.42.42.2(pid=15704): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15704)] 13:53:00.445395 run osmo-hlr_10.42.42.2(pid=15704): stdout: | (launched: 2022-12-10_13:52:57.302298) 13:53:00.493589 run osmo-hlr_10.42.42.2(pid=15704): stderr: | [0;m[1;31m20221210135257477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135257477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135257477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135257477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135257477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135257477 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135257490 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135257499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135257499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135257499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:00.542075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15703): Terminating (SIGTERM) 13:53:00.580902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15706): Terminating (SIGTERM) 13:53:00.619683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15709): Terminating (SIGTERM) 13:53:00.658806 --- ParallelTerminationStrategy: PID 15703 died... 13:53:00.677538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15703): Terminated: ok {rc=0} 13:53:00.721294 --- ParallelTerminationStrategy: PID 15706 died... 13:53:00.739584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15706): Terminated: ok {rc=0} 13:53:00.782655 --- ParallelTerminationStrategy: PID 15709 died... 13:53:00.800902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15709): Terminated: ok {rc=0} 13:53:00.895375 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:53:02.210356 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:53:02.217364 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:53:02.250127 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:53:02.287693 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:53:02.372801 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:53:02.404167 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:53:02.441793 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:53:03.036538 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:53:03.084117 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:03.094893 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:53:03.160259 tst cs_paging_gprs_active.py: using LAC 28848 13:53:03.279959 tst cs_paging_gprs_active.py: using RAC 33 13:53:03.397365 tst cs_paging_gprs_active.py: using CellId 28848 13:53:03.516925 tst cs_paging_gprs_active.py: using BVCI 28849 13:53:03.626460 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:03.637210 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:03.647733 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:03.658356 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:03.668846 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:03.679437 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:03.690078 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:03.700477 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:03.711193 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:53:03.830569 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:53:03.945966 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:53:04.145959 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:53:04.445672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15714): Launched 13:53:04.705548 run iperf3-srv_10.42.42.10(pid=15715): Launched 13:53:04.818573 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:53:05.018788 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:53:05.338165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15716): Launched 13:53:05.616934 run iperf3-srv_10.42.42.10(pid=15717): Launched 13:53:05.736885 tst cs_paging_gprs_active.py:38: start network... 13:53:05.952376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:06.448186 run create_hlr_db(pid=15718): Launched 13:53:06.570752 bus /gobi_6: Setting Powered False 13:53:07.634301 run create_hlr_db(pid=15718): Terminated: ok {rc=0} 13:53:08.061054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15720): Launched 13:53:08.360019 run osmo-hlr_10.42.42.2(pid=15721): Launched 13:53:08.474407 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:08.993412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15723): Launched 13:53:09.295070 run osmo-stp_10.42.42.5(pid=15724): Launched 13:53:09.409321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:09.926854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15726): Launched 13:53:10.041062 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:10.293767 run patchelf(pid=15727): Launched 13:53:10.459517 run osmo-stp_10.42.42.5(pid=15724): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15724)] 13:53:10.586237 run osmo-stp_10.42.42.5(pid=15724): stdout: | (launched: 2022-12-10_13:53:09.239808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:10.714464 run osmo-stp_10.42.42.5(pid=15724): stderr: | [0;m[38;5;43m20221210135309411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135309412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135309412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135309412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135309413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135309413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135309413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:10.842941 run osmo-stp_10.42.42.5(pid=15724): stdout: | (launched: 2022-12-10_13:53:09.239808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:10.965616 run osmo-stp_10.42.42.5(pid=15724): stderr: | [0;m[38;5;43m20221210135309411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135309412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135309412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135309412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135309413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135309413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135309413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:11.110665 run patchelf(pid=15727): Terminating (SIGINT) 13:53:11.279161 run patchelf(pid=15727): Terminated: ok {rc=0} 13:53:11.400601 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15724): Process ended prematurely: osmo-stp_10.42.42.5(pid=15724) [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15724)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:53:11.409996 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 13:53:11.436699 run osmo-hlr_10.42.42.2(pid=15721): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15721)] 13:53:11.484009 run osmo-hlr_10.42.42.2(pid=15721): stdout: | (launched: 2022-12-10_13:53:08.305430) 13:53:11.533627 run osmo-hlr_10.42.42.2(pid=15721): stderr: | [0;m[1;31m20221210135308479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135308479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135308479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135308479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135308479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135308479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135308492 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135308502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135308503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135308503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:11.583065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15714): Terminating (SIGTERM) 13:53:11.622051 run iperf3-srv_10.42.42.10(pid=15715): Terminating (SIGTERM) 13:53:11.660876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15716): Terminating (SIGTERM) 13:53:11.699836 run iperf3-srv_10.42.42.10(pid=15717): Terminating (SIGTERM) 13:53:11.738692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15720): Terminating (SIGTERM) 13:53:11.777800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15723): Terminating (SIGTERM) 13:53:11.816641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15726): Terminating (SIGTERM) 13:53:11.855908 --- ParallelTerminationStrategy: PID 15714 died... 13:53:11.874440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15714): Terminated: ok {rc=0} 13:53:11.918249 --- ParallelTerminationStrategy: PID 15715 died... 13:53:11.936650 run iperf3-srv_10.42.42.10(pid=15715): Terminated {rc=256} 13:53:11.979703 --- ParallelTerminationStrategy: PID 15716 died... 13:53:11.998022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15716): Terminated: ok {rc=0} 13:53:12.041181 --- ParallelTerminationStrategy: PID 15717 died... 13:53:12.059475 run iperf3-srv_10.42.42.10(pid=15717): Terminated {rc=256} 13:53:12.102616 --- ParallelTerminationStrategy: PID 15720 died... 13:53:12.121162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15720): Terminated: ok {rc=0} 13:53:12.164191 --- ParallelTerminationStrategy: PID 15723 died... 13:53:12.182585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15723): Terminated: ok {rc=0} 13:53:12.225781 --- ParallelTerminationStrategy: PID 15726 died... 13:53:12.244241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15726): Terminated: ok {rc=0} 13:53:12.327099 bus /gobi_0: Setting Powered False 13:53:13.426601 bus /gobi_0: Setting Powered False 13:53:14.541286 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:53:15.690530 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:15.702344 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:53:15.772870 tst iperf3.py: using LAC 28849 13:53:15.927438 tst iperf3.py: using RAC 34 13:53:16.050359 tst iperf3.py: using CellId 28849 13:53:16.171724 tst iperf3.py: using BVCI 28850 13:53:16.312862 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:16.325797 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:16.339786 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:16.353438 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:16.366004 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:16.380540 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:16.394315 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:16.406724 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:16.420643 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:53:16.554767 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:53:16.810411 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:53:17.146660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15764): Launched 13:53:17.439733 run iperf3-srv_10.42.42.10(pid=15772): Launched 13:53:17.583787 tst iperf3.py:8: start network... 13:53:17.787322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:18.338818 run create_hlr_db(pid=15806): Launched 13:53:18.509359 bus /gobi_6: Setting Powered False 13:53:19.572102 run create_hlr_db(pid=15806): Terminated: ok {rc=0} 13:53:20.061965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16002): Launched 13:53:20.410399 run osmo-hlr_10.42.42.2(pid=16003): Launched 13:53:20.654158 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:21.329713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16006): Launched 13:53:21.649674 run osmo-stp_10.42.42.5(pid=16008): Launched 13:53:21.892919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:22.537331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16010): Launched 13:53:22.674005 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:22.962809 run patchelf(pid=16011): Launched 13:53:23.154410 run osmo-stp_10.42.42.5(pid=16008): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16008)] 13:53:23.294451 run osmo-stp_10.42.42.5(pid=16008): stdout: | (launched: 2022-12-10_13:53:21.582890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:23.435322 run osmo-stp_10.42.42.5(pid=16008): stderr: | [0;m[38;5;43m20221210135321872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135321873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135321873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135321873 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135321874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135321874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135321874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:23.576914 run osmo-stp_10.42.42.5(pid=16008): stdout: | (launched: 2022-12-10_13:53:21.582890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:23.713106 run osmo-stp_10.42.42.5(pid=16008): stderr: | [0;m[38;5;43m20221210135321872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135321873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135321873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135321873 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135321874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135321874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135321874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:23.872891 run patchelf(pid=16011): Terminating (SIGINT) 13:53:24.057594 run patchelf(pid=16011): Terminated: ok {rc=0} 13:53:24.191827 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16008): Process ended prematurely: osmo-stp_10.42.42.5(pid=16008) [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16008)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 13:53:24.203300 tst iperf3.py:8: Test FAILED (8.5 sec) 13:53:24.235560 run osmo-hlr_10.42.42.2(pid=16003): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16003)] 13:53:24.288245 run osmo-hlr_10.42.42.2(pid=16003): stdout: | (launched: 2022-12-10_13:53:20.334398) 13:53:24.343608 run osmo-hlr_10.42.42.2(pid=16003): stderr: | [0;m[1;31m20221210135320646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135320646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135320646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135320646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135320646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135320646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135320661 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135320670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135320670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135320670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:24.398903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15764): Terminating (SIGTERM) 13:53:24.443696 run iperf3-srv_10.42.42.10(pid=15772): Terminating (SIGTERM) 13:53:24.491578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16002): Terminating (SIGTERM) 13:53:24.536136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16006): Terminating (SIGTERM) 13:53:24.583009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16010): Terminating (SIGTERM) 13:53:24.630779 --- ParallelTerminationStrategy: PID 15764 died... 13:53:24.651626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15764): Terminated: ok {rc=0} 13:53:24.702989 --- ParallelTerminationStrategy: PID 15772 died... 13:53:24.723230 run iperf3-srv_10.42.42.10(pid=15772): Terminated {rc=256} 13:53:24.773307 --- ParallelTerminationStrategy: PID 16002 died... 13:53:24.794022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16002): Terminated: ok {rc=0} 13:53:24.844253 --- ParallelTerminationStrategy: PID 16006 died... 13:53:24.865289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16006): Terminated: ok {rc=0} 13:53:24.914984 --- ParallelTerminationStrategy: PID 16010 died... 13:53:24.935715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16010): Terminated: ok {rc=0} 13:53:25.027709 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:53:26.183952 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:26.196938 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:53:26.268542 tst iperf3m4.py: using LAC 28850 13:53:26.398925 tst iperf3m4.py: using RAC 35 13:53:26.528001 tst iperf3m4.py: using CellId 28850 13:53:26.661421 tst iperf3m4.py: using BVCI 28851 13:53:26.783231 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:26.795673 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:26.809251 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:26.821720 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:26.836017 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:26.849796 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:26.862278 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:26.876297 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:26.889823 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:53:27.014242 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:53:27.138090 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:53:27.255706 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:53:27.375224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:53:27.599977 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:53:27.936265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16012): Launched 13:53:28.240217 run iperf3-srv_10.42.42.10(pid=16013): Launched 13:53:28.380251 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:53:28.605399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:53:28.941815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16014): Launched 13:53:29.249745 run iperf3-srv_10.42.42.10(pid=16015): Launched 13:53:29.383649 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:53:29.608235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:53:29.945640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16016): Launched 13:53:30.249490 run iperf3-srv_10.42.42.10(pid=16017): Launched 13:53:30.387186 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:53:30.612576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:53:31.018813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16018): Launched 13:53:31.359124 run iperf3-srv_10.42.42.10(pid=16019): Launched 13:53:31.524005 tst iperf3m4.py:8: start network... 13:53:31.804622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:32.437085 run create_hlr_db(pid=16020): Launched 13:53:32.624917 bus /gobi_6: Setting Powered False 13:53:33.688928 run create_hlr_db(pid=16020): Terminated: ok {rc=0} 13:53:34.197844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16022): Launched 13:53:34.542048 run osmo-hlr_10.42.42.2(pid=16023): Launched 13:53:34.795361 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:35.476314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16025): Launched 13:53:35.829675 run osmo-stp_10.42.42.5(pid=16026): Launched 13:53:36.081164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:36.740003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16028): Launched 13:53:36.874912 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:37.162593 run patchelf(pid=16029): Launched 13:53:37.359006 run osmo-stp_10.42.42.5(pid=16026): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16026)] 13:53:37.501179 run osmo-stp_10.42.42.5(pid=16026): stdout: | (launched: 2022-12-10_13:53:35.759414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:37.646411 run osmo-stp_10.42.42.5(pid=16026): stderr: | [0;m[38;5;43m20221210135336070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135336070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135336070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135336071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135336071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135336071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135336071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:37.790798 run osmo-stp_10.42.42.5(pid=16026): stdout: | (launched: 2022-12-10_13:53:35.759414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:37.927407 run osmo-stp_10.42.42.5(pid=16026): stderr: | [0;m[38;5;43m20221210135336070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135336070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135336070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135336071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135336071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135336071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135336071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:38.091122 run patchelf(pid=16029): Terminating (SIGINT) 13:53:38.278683 run patchelf(pid=16029): Terminated: ok {rc=0} 13:53:38.414955 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16026): Process ended prematurely: osmo-stp_10.42.42.5(pid=16026) [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16026)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:53:38.426745 tst iperf3m4.py:8: Test FAILED (12.3 sec) 13:53:38.459594 run osmo-hlr_10.42.42.2(pid=16023): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16023)] 13:53:38.512443 run osmo-hlr_10.42.42.2(pid=16023): stdout: | (launched: 2022-12-10_13:53:34.476433) 13:53:38.567924 run osmo-hlr_10.42.42.2(pid=16023): stderr: | [0;m[1;31m20221210135334805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135334805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135334805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135334805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135334805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135334805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135334817 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135334830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135334830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135334830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:38.627078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16012): Terminating (SIGTERM) 13:53:38.672156 run iperf3-srv_10.42.42.10(pid=16013): Terminating (SIGTERM) 13:53:38.719748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16014): Terminating (SIGTERM) 13:53:38.765085 run iperf3-srv_10.42.42.10(pid=16015): Terminating (SIGTERM) 13:53:38.813748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16016): Terminating (SIGTERM) 13:53:38.858864 run iperf3-srv_10.42.42.10(pid=16017): Terminating (SIGTERM) 13:53:38.906555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16018): Terminating (SIGTERM) 13:53:38.952185 run iperf3-srv_10.42.42.10(pid=16019): Terminating (SIGTERM) 13:53:39.000477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16022): Terminating (SIGTERM) 13:53:39.045977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16025): Terminating (SIGTERM) 13:53:39.092502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16028): Terminating (SIGTERM) 13:53:39.139501 --- ParallelTerminationStrategy: PID 16012 died... 13:53:39.160576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16012): Terminated: ok {rc=0} 13:53:39.213320 --- ParallelTerminationStrategy: PID 16013 died... 13:53:39.234113 run iperf3-srv_10.42.42.10(pid=16013): Terminated {rc=256} 13:53:39.284208 --- ParallelTerminationStrategy: PID 16014 died... 13:53:39.305230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16014): Terminated: ok {rc=0} 13:53:39.356176 --- ParallelTerminationStrategy: PID 16015 died... 13:53:39.378368 run iperf3-srv_10.42.42.10(pid=16015): Terminated {rc=256} 13:53:39.428291 --- ParallelTerminationStrategy: PID 16016 died... 13:53:39.449585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16016): Terminated: ok {rc=0} 13:53:39.499908 --- ParallelTerminationStrategy: PID 16017 died... 13:53:39.520877 run iperf3-srv_10.42.42.10(pid=16017): Terminated {rc=256} 13:53:39.571807 --- ParallelTerminationStrategy: PID 16018 died... 13:53:39.594350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16018): Terminated: ok {rc=0} 13:53:39.645695 --- ParallelTerminationStrategy: PID 16019 died... 13:53:39.666766 run iperf3-srv_10.42.42.10(pid=16019): Terminated {rc=256} 13:53:39.716696 --- ParallelTerminationStrategy: PID 16022 died... 13:53:39.737638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16022): Terminated: ok {rc=0} 13:53:39.788861 --- ParallelTerminationStrategy: PID 16025 died... 13:53:39.809959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16025): Terminated: ok {rc=0} 13:53:39.862910 --- ParallelTerminationStrategy: PID 16028 died... 13:53:39.883696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16028): Terminated: ok {rc=0} 13:53:39.979001 bus /gobi_4: Setting Powered False 13:53:41.080716 bus /gobi_4: Setting Powered False 13:53:42.196872 bus /gobi_1: Setting Powered False 13:53:43.294233 bus /gobi_1: Setting Powered False 13:53:44.411772 bus /gobi_0: Setting Powered False 13:53:45.510033 bus /gobi_0: Setting Powered False 13:53:46.634347 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:53:47.752270 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:47.764279 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:53:47.832551 tst ping.py: using LAC 28851 13:53:47.956533 tst ping.py: using RAC 36 13:53:48.081383 tst ping.py: using CellId 28851 13:53:48.204842 tst ping.py: using BVCI 28852 13:53:48.313447 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:48.324383 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:48.335004 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:48.346223 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:48.357617 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:48.368881 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:48.380603 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:48.391748 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:53:48.511012 tst ping.py:19: start network... 13:53:48.709460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:49.165395 run create_hlr_db(pid=16031): Launched 13:53:49.286010 bus /gobi_6: Setting Powered False 13:53:50.346135 run create_hlr_db(pid=16031): Terminated: ok {rc=0} 13:53:50.781513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16033): Launched 13:53:51.077516 run osmo-hlr_10.42.42.2(pid=16034): Launched 13:53:51.190159 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:51.706350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16036): Launched 13:53:52.001699 run osmo-stp_10.42.42.5(pid=16037): Launched 13:53:52.113659 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:52.622446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16039): Launched 13:53:52.734459 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:52.983312 run patchelf(pid=16040): Launched 13:53:53.147287 run osmo-stp_10.42.42.5(pid=16037): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16037)] 13:53:53.272445 run osmo-stp_10.42.42.5(pid=16037): stdout: | (launched: 2022-12-10_13:53:51.947217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:53.398891 run osmo-stp_10.42.42.5(pid=16037): stderr: | [0;m[38;5;43m20221210135352117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135352117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135352117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135352118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135352118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135352118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135352118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:53.525713 run osmo-stp_10.42.42.5(pid=16037): stdout: | (launched: 2022-12-10_13:53:51.947217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:53.647029 run osmo-stp_10.42.42.5(pid=16037): stderr: | [0;m[38;5;43m20221210135352117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135352117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135352117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135352118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135352118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135352118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135352118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:53.790906 run patchelf(pid=16040): Terminating (SIGINT) 13:53:53.958329 run patchelf(pid=16040): Terminated: ok {rc=0} 13:53:54.078113 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16037): Process ended prematurely: osmo-stp_10.42.42.5(pid=16037) [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16037)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 13:53:54.086797 tst ping.py:22: Test FAILED (6.3 sec) 13:53:54.113451 run osmo-hlr_10.42.42.2(pid=16034): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16034)] 13:53:54.160479 run osmo-hlr_10.42.42.2(pid=16034): stdout: | (launched: 2022-12-10_13:53:51.023218) 13:53:54.209290 run osmo-hlr_10.42.42.2(pid=16034): stderr: | [0;m[1;31m20221210135351197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135351197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135351197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135351197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135351197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135351197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135351209 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135351218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135351218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135351218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:54.258272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16033): Terminating (SIGTERM) 13:53:54.297656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16036): Terminating (SIGTERM) 13:53:54.336912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16039): Terminating (SIGTERM) 13:53:54.376631 --- ParallelTerminationStrategy: PID 16033 died... 13:53:54.395405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16033): Terminated: ok {rc=0} 13:53:54.439067 --- ParallelTerminationStrategy: PID 16036 died... 13:53:54.457522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16036): Terminated: ok {rc=0} 13:53:54.501230 --- ParallelTerminationStrategy: PID 16039 died... 13:53:54.519637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16039): Terminated: ok {rc=0} 13:53:54.604371 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:53:55.694389 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:55.706754 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:53:55.777813 tst ping_idle_ping.py: using LAC 28852 13:53:55.895189 tst ping_idle_ping.py: using RAC 37 13:53:56.013428 tst ping_idle_ping.py: using CellId 28852 13:53:56.138191 tst ping_idle_ping.py: using BVCI 28853 13:53:56.254330 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:56.265857 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:56.277212 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:56.289310 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:56.301095 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:56.313094 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:56.325359 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:53:56.337416 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:53:56.453160 tst ping_idle_ping.py:24: start network... 13:53:56.652552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:57.114232 run create_hlr_db(pid=16041): Launched 13:53:57.235151 bus /gobi_6: Setting Powered False 13:53:58.295033 run create_hlr_db(pid=16041): Terminated: ok {rc=0} 13:53:58.708461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16043): Launched 13:53:59.004237 run osmo-hlr_10.42.42.2(pid=16044): Launched 13:53:59.117071 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:59.638093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16046): Launched 13:53:59.932286 run osmo-stp_10.42.42.5(pid=16047): Launched 13:54:00.044628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:54:00.553247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16049): Launched 13:54:00.665279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:54:00.950087 run patchelf(pid=16050): Launched 13:54:01.137346 run osmo-stp_10.42.42.5(pid=16047): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16047)] 13:54:01.275758 run osmo-stp_10.42.42.5(pid=16047): stdout: | (launched: 2022-12-10_13:53:59.877537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:01.417411 run osmo-stp_10.42.42.5(pid=16047): stderr: | [0;m[38;5;43m20221210135400046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135400046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135400047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135400047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135400047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135400047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135400048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:01.557288 run osmo-stp_10.42.42.5(pid=16047): stdout: | (launched: 2022-12-10_13:53:59.877537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:01.694744 run osmo-stp_10.42.42.5(pid=16047): stderr: | [0;m[38;5;43m20221210135400046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135400046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135400047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135400047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135400047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135400047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135400048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:01.854999 run patchelf(pid=16050): Terminating (SIGINT) 13:54:02.039377 run patchelf(pid=16050): Terminated: ok {rc=0} 13:54:02.170918 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16047): Process ended prematurely: osmo-stp_10.42.42.5(pid=16047) [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16047)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:54:02.181458 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:54:02.211039 run osmo-hlr_10.42.42.2(pid=16044): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16044)] 13:54:02.262708 run osmo-hlr_10.42.42.2(pid=16044): stdout: | (launched: 2022-12-10_13:53:58.949781) 13:54:02.315361 run osmo-hlr_10.42.42.2(pid=16044): stderr: | [0;m[1;31m20221210135359125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135359125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135359125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135359125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135359125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135359125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135359136 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135359147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135359147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135359147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:02.368627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16043): Terminating (SIGTERM) 13:54:02.411318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16046): Terminating (SIGTERM) 13:54:02.453945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16049): Terminating (SIGTERM) 13:54:02.496869 --- ParallelTerminationStrategy: PID 16043 died... 13:54:02.516921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16043): Terminated: ok {rc=0} 13:54:02.564585 --- ParallelTerminationStrategy: PID 16046 died... 13:54:02.584197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16046): Terminated: ok {rc=0} 13:54:02.631987 --- ParallelTerminationStrategy: PID 16049 died... 13:54:02.651595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16049): Terminated: ok {rc=0} 13:54:02.739778 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:54:04.044595 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:04.051977 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:54:04.083828 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 13:54:04.121600 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 13:54:04.207337 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:54:04.239585 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 13:54:04.276580 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 13:54:04.873891 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 13:54:04.921434 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:04.932549 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:54:04.979220 tst cs_paging_gprs_active.py: using LAC 28853 13:54:05.093914 tst cs_paging_gprs_active.py: using RAC 38 13:54:05.209406 tst cs_paging_gprs_active.py: using CellId 28853 13:54:05.326138 tst cs_paging_gprs_active.py: using BVCI 28854 13:54:05.433697 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:05.444655 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:05.455687 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:05.466642 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:05.477618 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:05.488361 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:05.499385 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:05.510232 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:05.521481 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:54:05.641474 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:54:05.760439 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:54:05.974202 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:54:06.291426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16055): Launched 13:54:06.567951 run iperf3-srv_10.42.42.10(pid=16056): Launched 13:54:06.687344 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:54:06.899833 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:54:07.217445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16057): Launched 13:54:07.493579 run iperf3-srv_10.42.42.10(pid=16058): Launched 13:54:07.612554 tst cs_paging_gprs_active.py:38: start network... 13:54:07.826826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:08.320095 run create_hlr_db(pid=16059): Launched 13:54:08.442537 bus /gobi_6: Setting Powered False 13:54:09.505316 run create_hlr_db(pid=16059): Terminated: ok {rc=0} 13:54:09.929018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16061): Launched 13:54:10.225471 run osmo-hlr_10.42.42.2(pid=16062): Launched 13:54:10.339262 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:10.888123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16064): Launched 13:54:11.204377 run osmo-stp_10.42.42.5(pid=16065): Launched 13:54:11.325498 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:54:11.872786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16067): Launched 13:54:11.994366 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:54:12.262832 run patchelf(pid=16068): Launched 13:54:12.439259 run osmo-stp_10.42.42.5(pid=16065): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16065)] 13:54:12.573917 run osmo-stp_10.42.42.5(pid=16065): stdout: | (launched: 2022-12-10_13:54:11.147211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:12.709805 run osmo-stp_10.42.42.5(pid=16065): stderr: | [0;m[38;5;43m20221210135411339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135411339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135411340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135411340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135411340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135411341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135411341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:12.846003 run osmo-stp_10.42.42.5(pid=16065): stdout: | (launched: 2022-12-10_13:54:11.147211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:12.976569 run osmo-stp_10.42.42.5(pid=16065): stderr: | [0;m[38;5;43m20221210135411339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135411339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135411340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135411340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135411340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135411341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135411341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:13.131659 run patchelf(pid=16068): Terminating (SIGINT) 13:54:13.310247 run patchelf(pid=16068): Terminated: ok {rc=0} 13:54:13.439904 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16065): Process ended prematurely: osmo-stp_10.42.42.5(pid=16065) [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16065)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 13:54:13.450296 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:54:13.479126 run osmo-hlr_10.42.42.2(pid=16062): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16062)] 13:54:13.529298 run osmo-hlr_10.42.42.2(pid=16062): stdout: | (launched: 2022-12-10_13:54:10.171855) 13:54:13.581234 run osmo-hlr_10.42.42.2(pid=16062): stderr: | [0;m[1;31m20221210135410344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135410344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135410344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135410344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135410344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135410344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135410355 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135410363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135410364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135410364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:13.633627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16055): Terminating (SIGTERM) 13:54:13.675509 run iperf3-srv_10.42.42.10(pid=16056): Terminating (SIGTERM) 13:54:13.717388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16057): Terminating (SIGTERM) 13:54:13.759341 run iperf3-srv_10.42.42.10(pid=16058): Terminating (SIGTERM) 13:54:13.801086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16061): Terminating (SIGTERM) 13:54:13.843053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16064): Terminating (SIGTERM) 13:54:13.884898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16067): Terminating (SIGTERM) 13:54:13.926934 --- ParallelTerminationStrategy: PID 16055 died... 13:54:13.946554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16055): Terminated: ok {rc=0} 13:54:13.992885 --- ParallelTerminationStrategy: PID 16056 died... 13:54:14.012608 run iperf3-srv_10.42.42.10(pid=16056): Terminated {rc=256} 13:54:14.058942 --- ParallelTerminationStrategy: PID 16057 died... 13:54:14.078284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16057): Terminated: ok {rc=0} 13:54:14.124640 --- ParallelTerminationStrategy: PID 16058 died... 13:54:14.143887 run iperf3-srv_10.42.42.10(pid=16058): Terminated {rc=256} 13:54:14.190239 --- ParallelTerminationStrategy: PID 16061 died... 13:54:14.209643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16061): Terminated: ok {rc=0} 13:54:14.255746 --- ParallelTerminationStrategy: PID 16064 died... 13:54:14.275123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16064): Terminated: ok {rc=0} 13:54:14.321257 --- ParallelTerminationStrategy: PID 16067 died... 13:54:14.340700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16067): Terminated: ok {rc=0} 13:54:14.428830 bus /gobi_0: Setting Powered False 13:54:15.526793 bus /gobi_0: Setting Powered False 13:54:16.651953 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 13:54:17.802972 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:17.814897 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:54:17.863830 tst iperf3.py: using LAC 28854 13:54:17.982946 tst iperf3.py: using RAC 39 13:54:18.102401 tst iperf3.py: using CellId 28854 13:54:18.221589 tst iperf3.py: using BVCI 28855 13:54:18.329730 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:18.340809 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:18.351851 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:18.362842 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:18.373885 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:18.384868 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:18.396012 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:18.406872 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:18.418086 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:54:18.535782 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:54:18.749318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:54:19.065474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16069): Launched 13:54:19.339909 run iperf3-srv_10.42.42.10(pid=16070): Launched 13:54:19.459015 tst iperf3.py:8: start network... 13:54:19.671965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:20.162245 run create_hlr_db(pid=16071): Launched 13:54:20.283913 bus /gobi_6: Setting Powered False 13:54:21.347496 run create_hlr_db(pid=16071): Terminated: ok {rc=0} 13:54:21.772215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16073): Launched 13:54:22.067390 run osmo-hlr_10.42.42.2(pid=16074): Launched 13:54:22.180934 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:22.691914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16076): Launched 13:54:22.986972 run osmo-stp_10.42.42.5(pid=16077): Launched 13:54:23.100151 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:54:23.611062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16079): Launched 13:54:23.724094 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:54:23.974367 run patchelf(pid=16080): Launched 13:54:24.139857 run osmo-stp_10.42.42.5(pid=16077): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16077)] 13:54:24.264874 run osmo-stp_10.42.42.5(pid=16077): stdout: | (launched: 2022-12-10_13:54:22.932921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:24.391972 run osmo-stp_10.42.42.5(pid=16077): stderr: | [0;m[38;5;43m20221210135423103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135423104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135423104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135423104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135423105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135423105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135423105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:24.518993 run osmo-stp_10.42.42.5(pid=16077): stdout: | (launched: 2022-12-10_13:54:22.932921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:24.640628 run osmo-stp_10.42.42.5(pid=16077): stderr: | [0;m[38;5;43m20221210135423103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135423104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135423104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135423104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135423105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135423105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135423105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:24.785539 run patchelf(pid=16080): Terminating (SIGINT) 13:54:24.952387 run patchelf(pid=16080): Terminated: ok {rc=0} 13:54:25.072676 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16077): Process ended prematurely: osmo-stp_10.42.42.5(pid=16077) [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16077)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 13:54:25.082151 tst iperf3.py:8: Test FAILED (7.3 sec) 13:54:25.108473 run osmo-hlr_10.42.42.2(pid=16074): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16074)] 13:54:25.155316 run osmo-hlr_10.42.42.2(pid=16074): stdout: | (launched: 2022-12-10_13:54:22.013815) 13:54:25.203898 run osmo-hlr_10.42.42.2(pid=16074): stderr: | [0;m[1;31m20221210135422190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135422190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135422190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135422191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135422191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135422191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135422203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135422211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135422212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135422212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:25.252670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16069): Terminating (SIGTERM) 13:54:25.291343 run iperf3-srv_10.42.42.10(pid=16070): Terminating (SIGTERM) 13:54:25.329712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16073): Terminating (SIGTERM) 13:54:25.368443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16076): Terminating (SIGTERM) 13:54:25.407190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16079): Terminating (SIGTERM) 13:54:25.446029 --- ParallelTerminationStrategy: PID 16069 died... 13:54:25.464428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16069): Terminated: ok {rc=0} 13:54:25.508006 --- ParallelTerminationStrategy: PID 16070 died... 13:54:25.526185 run iperf3-srv_10.42.42.10(pid=16070): Terminated {rc=256} 13:54:25.569387 --- ParallelTerminationStrategy: PID 16073 died... 13:54:25.587661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16073): Terminated: ok {rc=0} 13:54:25.630538 --- ParallelTerminationStrategy: PID 16076 died... 13:54:25.648841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16076): Terminated: ok {rc=0} 13:54:25.691506 --- ParallelTerminationStrategy: PID 16079 died... 13:54:25.709677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16079): Terminated: ok {rc=0} 13:54:25.794397 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 13:54:26.939214 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:26.951159 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:54:27.002224 tst iperf3m4.py: using LAC 28855 13:54:27.119984 tst iperf3m4.py: using RAC 40 13:54:27.236450 tst iperf3m4.py: using CellId 28855 13:54:27.352896 tst iperf3m4.py: using BVCI 28856 13:54:27.460766 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:27.471925 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:27.483043 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:27.494073 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:27.505053 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:27.515967 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:27.527037 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:27.537944 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:27.549063 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:54:27.668905 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:54:27.787834 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:54:27.906774 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:54:28.021906 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:54:28.223846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:54:28.522390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16081): Launched 13:54:28.779889 run iperf3-srv_10.42.42.10(pid=16082): Launched 13:54:28.891122 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:54:29.089349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:54:29.386526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16083): Launched 13:54:29.644689 run iperf3-srv_10.42.42.10(pid=16084): Launched 13:54:29.755860 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:54:29.954552 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:54:30.252908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16085): Launched 13:54:30.511080 run iperf3-srv_10.42.42.10(pid=16086): Launched 13:54:30.622773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:54:30.821398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:54:31.134454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16087): Launched 13:54:31.435261 run iperf3-srv_10.42.42.10(pid=16088): Launched 13:54:31.563025 tst iperf3m4.py:8: start network... 13:54:31.766217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:32.233711 run create_hlr_db(pid=16089): Launched 13:54:32.355327 bus /gobi_6: Setting Powered False 13:54:33.414781 run create_hlr_db(pid=16089): Terminated: ok {rc=0} 13:54:33.846798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16091): Launched 13:54:34.161841 run osmo-hlr_10.42.42.2(pid=16092): Launched 13:54:34.282655 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:34.828432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16094): Launched 13:54:35.129758 run osmo-stp_10.42.42.5(pid=16095): Launched 13:54:35.242972 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:54:35.755737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16097): Launched 13:54:35.869059 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:54:36.120399 run patchelf(pid=16098): Launched 13:54:36.286552 run osmo-stp_10.42.42.5(pid=16095): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16095)] 13:54:36.412356 run osmo-stp_10.42.42.5(pid=16095): stdout: | (launched: 2022-12-10_13:54:35.075486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:36.539800 run osmo-stp_10.42.42.5(pid=16095): stderr: | [0;m[38;5;43m20221210135435246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135435246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135435246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135435247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135435247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135435247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135435247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:36.667178 run osmo-stp_10.42.42.5(pid=16095): stdout: | (launched: 2022-12-10_13:54:35.075486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:36.789737 run osmo-stp_10.42.42.5(pid=16095): stderr: | [0;m[38;5;43m20221210135435246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135435246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135435246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135435247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135435247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135435247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135435247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:36.934686 run patchelf(pid=16098): Terminating (SIGINT) 13:54:37.102361 run patchelf(pid=16098): Terminated: ok {rc=0} 13:54:37.223107 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16095): Process ended prematurely: osmo-stp_10.42.42.5(pid=16095) [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16095)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 13:54:37.232388 tst iperf3m4.py:8: Test FAILED (10.3 sec) 13:54:37.259246 run osmo-hlr_10.42.42.2(pid=16092): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16092)] 13:54:37.305876 run osmo-hlr_10.42.42.2(pid=16092): stdout: | (launched: 2022-12-10_13:54:34.104734) 13:54:37.354221 run osmo-hlr_10.42.42.2(pid=16092): stderr: | [0;m[1;31m20221210135434301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135434301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135434301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135434301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135434301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135434302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135434314 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135434322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135434323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135434323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:37.402865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16081): Terminating (SIGTERM) 13:54:37.441892 run iperf3-srv_10.42.42.10(pid=16082): Terminating (SIGTERM) 13:54:37.480770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16083): Terminating (SIGTERM) 13:54:37.519647 run iperf3-srv_10.42.42.10(pid=16084): Terminating (SIGTERM) 13:54:37.558581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16085): Terminating (SIGTERM) 13:54:37.597435 run iperf3-srv_10.42.42.10(pid=16086): Terminating (SIGTERM) 13:54:37.636155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16087): Terminating (SIGTERM) 13:54:37.675016 run iperf3-srv_10.42.42.10(pid=16088): Terminating (SIGTERM) 13:54:37.713749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16091): Terminating (SIGTERM) 13:54:37.752809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16094): Terminating (SIGTERM) 13:54:37.791599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16097): Terminating (SIGTERM) 13:54:37.830988 --- ParallelTerminationStrategy: PID 16081 died... 13:54:37.849614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16081): Terminated: ok {rc=0} 13:54:37.893095 --- ParallelTerminationStrategy: PID 16082 died... 13:54:37.911273 run iperf3-srv_10.42.42.10(pid=16082): Terminated {rc=256} 13:54:37.954146 --- ParallelTerminationStrategy: PID 16083 died... 13:54:37.972406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16083): Terminated: ok {rc=0} 13:54:38.015812 --- ParallelTerminationStrategy: PID 16084 died... 13:54:38.034129 run iperf3-srv_10.42.42.10(pid=16084): Terminated {rc=256} 13:54:38.077538 --- ParallelTerminationStrategy: PID 16085 died... 13:54:38.095813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16085): Terminated: ok {rc=0} 13:54:38.138536 --- ParallelTerminationStrategy: PID 16086 died... 13:54:38.156703 run iperf3-srv_10.42.42.10(pid=16086): Terminated {rc=256} 13:54:38.199430 --- ParallelTerminationStrategy: PID 16087 died... 13:54:38.217914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16087): Terminated: ok {rc=0} 13:54:38.261368 --- ParallelTerminationStrategy: PID 16088 died... 13:54:38.279400 run iperf3-srv_10.42.42.10(pid=16088): Terminated {rc=256} 13:54:38.322171 --- ParallelTerminationStrategy: PID 16091 died... 13:54:38.340268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16091): Terminated: ok {rc=0} 13:54:38.383290 --- ParallelTerminationStrategy: PID 16094 died... 13:54:38.401558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16094): Terminated: ok {rc=0} 13:54:38.444581 --- ParallelTerminationStrategy: PID 16097 died... 13:54:38.462927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16097): Terminated: ok {rc=0} 13:54:38.546977 bus /gobi_4: Setting Powered False 13:54:39.645579 bus /gobi_4: Setting Powered False 13:54:40.759495 bus /gobi_1: Setting Powered False 13:54:41.856532 bus /gobi_1: Setting Powered False 13:54:42.969849 bus /gobi_0: Setting Powered False 13:54:44.067289 bus /gobi_0: Setting Powered False 13:54:45.185097 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 13:54:46.286889 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:46.300096 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:54:46.359014 tst ping.py: using LAC 28856 13:54:46.503820 tst ping.py: using RAC 41 13:54:46.621051 tst ping.py: using CellId 28856 13:54:46.769316 tst ping.py: using BVCI 28857 13:54:46.917075 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:46.931084 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:46.945479 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:46.959490 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:46.971678 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:46.989308 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:47.006572 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:47.022999 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:54:47.153181 tst ping.py:19: start network... 13:54:47.379619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:47.832036 run create_hlr_db(pid=16099): Launched 13:54:47.951192 bus /gobi_6: Setting Powered False 13:54:49.009930 run create_hlr_db(pid=16099): Terminated: ok {rc=0} 13:54:49.435117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16101): Launched 13:54:49.746623 run osmo-hlr_10.42.42.2(pid=16102): Launched 13:54:49.864847 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:50.406215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16104): Launched 13:54:50.717510 run osmo-stp_10.42.42.5(pid=16105): Launched 13:54:50.836716 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:54:51.376701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16107): Launched 13:54:51.489402 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:54:51.736042 run patchelf(pid=16108): Launched 13:54:51.898523 run osmo-stp_10.42.42.5(pid=16105): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16105)] 13:54:52.022628 run osmo-stp_10.42.42.5(pid=16105): stdout: | (launched: 2022-12-10_13:54:50.661074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:52.148428 run osmo-stp_10.42.42.5(pid=16105): stderr: | [0;m[38;5;43m20221210135450852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135450853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135450853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135450853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135450854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135450854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135450854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:52.273985 run osmo-stp_10.42.42.5(pid=16105): stdout: | (launched: 2022-12-10_13:54:50.661074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:52.395395 run osmo-stp_10.42.42.5(pid=16105): stderr: | [0;m[38;5;43m20221210135450852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135450853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135450853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135450853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135450854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135450854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135450854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:52.538121 run patchelf(pid=16108): Terminating (SIGINT) 13:54:52.702771 run patchelf(pid=16108): Terminated: ok {rc=0} 13:54:52.821155 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16105): Process ended prematurely: osmo-stp_10.42.42.5(pid=16105) [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16105)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 13:54:52.829813 tst ping.py:22: Test FAILED (6.5 sec) 13:54:52.855979 run osmo-hlr_10.42.42.2(pid=16102): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16102)] 13:54:52.902778 run osmo-hlr_10.42.42.2(pid=16102): stdout: | (launched: 2022-12-10_13:54:49.690288) 13:54:52.951073 run osmo-hlr_10.42.42.2(pid=16102): stderr: | [0;m[1;31m20221210135449885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135449885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135449885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135449885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135449885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135449885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135449899 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135449909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135449909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135449909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:52.999920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16101): Terminating (SIGTERM) 13:54:53.038884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16104): Terminating (SIGTERM) 13:54:53.077914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16107): Terminating (SIGTERM) 13:54:53.117223 --- ParallelTerminationStrategy: PID 16101 died... 13:54:53.135923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16101): Terminated: ok {rc=0} 13:54:53.179303 --- ParallelTerminationStrategy: PID 16104 died... 13:54:53.197719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16104): Terminated: ok {rc=0} 13:54:53.241442 --- ParallelTerminationStrategy: PID 16107 died... 13:54:53.259780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16107): Terminated: ok {rc=0} 13:54:53.342931 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 13:54:54.429070 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:54.440923 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:54:54.493993 tst ping_idle_ping.py: using LAC 28857 13:54:54.609185 tst ping_idle_ping.py: using RAC 42 13:54:54.723114 tst ping_idle_ping.py: using CellId 28857 13:54:54.836599 tst ping_idle_ping.py: using BVCI 28858 13:54:54.942662 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:54.954153 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:54.965158 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:54.976183 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:54.987173 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:54.998209 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:55.009326 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:54:55.020343 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:54:55.133159 tst ping_idle_ping.py:24: start network... 13:54:55.328638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:55.783819 run create_hlr_db(pid=16109): Launched 13:54:55.903593 bus /gobi_6: Setting Powered False 13:54:56.961875 run create_hlr_db(pid=16109): Terminated: ok {rc=0} 13:54:57.369105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16111): Launched 13:54:57.661156 run osmo-hlr_10.42.42.2(pid=16112): Launched 13:54:57.772353 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:58.273633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16114): Launched 13:54:58.564307 run osmo-stp_10.42.42.5(pid=16115): Launched 13:54:58.676548 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:54:59.179329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16117): Launched 13:54:59.290361 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:54:59.537443 run patchelf(pid=16118): Launched 13:54:59.700701 run osmo-stp_10.42.42.5(pid=16115): ERR: Terminated: ERROR {rc=1} [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16115)] 13:54:59.824472 run osmo-stp_10.42.42.5(pid=16115): stdout: | (launched: 2022-12-10_13:54:58.511081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:59.950340 run osmo-stp_10.42.42.5(pid=16115): stderr: | [0;m[38;5;43m20221210135458681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135458681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135458681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135458682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135458682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135458682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135458682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:00.076141 run osmo-stp_10.42.42.5(pid=16115): stdout: | (launched: 2022-12-10_13:54:58.511081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:00.196831 run osmo-stp_10.42.42.5(pid=16115): stderr: | [0;m[38;5;43m20221210135458681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135458681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135458681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135458682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135458682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135458682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135458682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:00.339478 run patchelf(pid=16118): Terminating (SIGINT) 13:55:00.506095 run patchelf(pid=16118): Terminated: ok {rc=0} 13:55:00.625441 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16115): Process ended prematurely: osmo-stp_10.42.42.5(pid=16115) [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16115)] [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 13:55:00.634092 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 13:55:00.660184 run osmo-hlr_10.42.42.2(pid=16112): ERR: Terminated: ERROR {rc=237} [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16112)] 13:55:00.706458 run osmo-hlr_10.42.42.2(pid=16112): stdout: | (launched: 2022-12-10_13:54:57.607583) 13:55:00.754387 run osmo-hlr_10.42.42.2(pid=16112): stderr: | [0;m[1;31m20221210135457781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135457781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135457781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135457781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135457781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135457781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135457794 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135457802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135457803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135457803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:00.802822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16111): Terminating (SIGTERM) 13:55:00.841714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16114): Terminating (SIGTERM) 13:55:00.881287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16117): Terminating (SIGTERM) 13:55:00.921638 --- ParallelTerminationStrategy: PID 16111 died... 13:55:00.940718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16111): Terminated: ok {rc=0} 13:55:00.985913 --- ParallelTerminationStrategy: PID 16114 died... 13:55:01.004407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16114): Terminated: ok {rc=0} 13:55:01.048013 --- ParallelTerminationStrategy: PID 16117 died... 13:55:01.077535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16117): Terminated: ok {rc=0} 13:55:01.164189 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 13:55:02.479140 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:55:02.486396 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:55:02.517628 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:55:02.551176 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:55:02.605769 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:55:02.637423 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:55:02.670809 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:55:03.228852 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2375 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:55:03.234063 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:55:03.245503 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:55:03.310426 tst switch_tch_pdch.py: using LAC 28858 13:55:03.425796 tst switch_tch_pdch.py: using RAC 43 13:55:03.538915 tst switch_tch_pdch.py: using CellId 28858 13:55:03.652504 tst switch_tch_pdch.py: using BVCI 28859 13:55:03.758827 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:55:03.770128 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:55:03.781224 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:55:03.792324 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:55:03.803457 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:55:03.814528 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:55:03.825789 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:55:03.836926 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:55:03.954348 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:55:04.074660 tst switch_tch_pdch.py:51: start network... 13:55:04.284632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:04.768499 run create_hlr_db(pid=16125): Launched 13:55:04.887696 bus /gobi_6: Setting Powered False 13:55:05.948696 run create_hlr_db(pid=16125): Terminated: ok {rc=0} 13:55:06.365605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16127): Launched 13:55:06.657763 run osmo-hlr_10.42.42.2(pid=16128): Launched 13:55:06.768919 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:07.270033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16130): Launched 13:55:07.561047 run osmo-stp_10.42.42.5(pid=16131): Launched 13:55:07.671924 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:55:08.175558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16133): Launched 13:55:08.294704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:55:08.558298 run patchelf(pid=16134): Launched 13:55:08.732227 run osmo-stp_10.42.42.5(pid=16131): ERR: Terminated: ERROR {rc=1} [trial-2375↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16131)] 13:55:08.865166 run osmo-stp_10.42.42.5(pid=16131): stdout: | (launched: 2022-12-10_13:55:07.507313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:08.999256 run osmo-stp_10.42.42.5(pid=16131): stderr: | [0;m[38;5;43m20221210135507678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135507678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135507678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135507678 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135507679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135507679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135507679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:09.133874 run osmo-stp_10.42.42.5(pid=16131): stdout: | (launched: 2022-12-10_13:55:07.507313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:09.262942 run osmo-stp_10.42.42.5(pid=16131): stderr: | [0;m[38;5;43m20221210135507678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135507678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135507678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135507678 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135507679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135507679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135507679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:09.415992 run patchelf(pid=16134): Terminating (SIGINT) 13:55:09.592366 run patchelf(pid=16134): Terminated: ok {rc=0} 13:55:09.719741 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16131): Process ended prematurely: osmo-stp_10.42.42.5(pid=16131) [trial-2375↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16131)] [trial-2375↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:55:09.729438 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 13:55:09.757704 run osmo-hlr_10.42.42.2(pid=16128): ERR: Terminated: ERROR {rc=237} [trial-2375↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16128)] 13:55:09.807699 run osmo-hlr_10.42.42.2(pid=16128): stdout: | (launched: 2022-12-10_13:55:06.604224) 13:55:09.859157 run osmo-hlr_10.42.42.2(pid=16128): stderr: | [0;m[1;31m20221210135506781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135506781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135506781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135506781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135506781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135506781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135506794 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135506802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135506802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135506802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:09.911303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16127): Terminating (SIGTERM) 13:55:09.953054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16130): Terminating (SIGTERM) 13:55:09.994739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16133): Terminating (SIGTERM) 13:55:10.036798 --- ParallelTerminationStrategy: PID 16127 died... 13:55:10.056542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16127): Terminated: ok {rc=0} 13:55:10.102810 --- ParallelTerminationStrategy: PID 16130 died... 13:55:10.122136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16130): Terminated: ok {rc=0} 13:55:10.168431 --- ParallelTerminationStrategy: PID 16133 died... 13:55:10.187879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16133): Terminated: ok {rc=0} 13:55:10.276193 bus /gobi_0: Setting Powered False 13:55:11.372266 bus /gobi_0: Setting Powered False 13:55:12.485218 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2375 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 nitb_smpp --------------------------------------------------------------------- 13:55:13.734536 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:55:13.736810 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 13:55:13.756734 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 13:55:13.763490 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 13:55:13.797404 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 13:55:13.818324 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 13:55:13.825504 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 13:55:14.344557 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2375 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 13:55:14.349999 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 13:55:14.368686 tst esme_connect_policy_acceptall.py: using MSISDN 7765 13:55:14.507590 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:55:15.101396 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16138): Launched 13:55:15.419410 run osmo-nitb_10.42.42.2(pid=16139): Launched 13:55:15.594880 run osmo-nitb_10.42.42.2(pid=16139): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16139)] 13:55:15.737343 run osmo-nitb_10.42.42.2(pid=16139): stdout: | (launched: 2022-12-10_13:55:15.361777) 13:55:15.909769 run osmo-nitb_10.42.42.2(pid=16139): stderr: | (launched: 2022-12-10_13:55:15.409736) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:55:16.056786 run osmo-nitb_10.42.42.2(pid=16139): stdout: | (launched: 2022-12-10_13:55:15.361777) 13:55:16.198439 run osmo-nitb_10.42.42.2(pid=16139): stderr: | (launched: 2022-12-10_13:55:15.409736) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16139): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16139) [trial-2375↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16139)] 13:55:16.538863 tst osmo-nitb_10.42.42.2(pid=16139): stdout: | (launched: 2022-12-10_13:55:15.361777) 13:55:16.710554 tst osmo-nitb_10.42.42.2(pid=16139): stderr: | (launched: 2022-12-10_13:55:15.409736) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:55:16.858199 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=16139): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16139) [trial-2375↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16139)] [trial-2375↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 13:55:16.866868 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 13:55:16.873821 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16138): Terminating (SIGTERM) 13:55:17.084379 --- ParallelTerminationStrategy: PID 16138 died... 13:55:17.106677 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16138): Terminated: ok {rc=0} ---------------------------------------------- trial-2375 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 13:55:17.166286 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 13:55:17.186830 tst esme_connect_policy_closed.py: using MSISDN 7766 13:55:17.310368 tst esme_connect_policy_closed.py: using MSISDN 7767 13:55:17.419926 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:55:17.977710 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16141): Launched 13:55:18.295302 run osmo-nitb_10.42.42.2(pid=16142): Launched 13:55:18.467269 run osmo-nitb_10.42.42.2(pid=16142): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16142)] 13:55:18.598810 run osmo-nitb_10.42.42.2(pid=16142): stdout: | (launched: 2022-12-10_13:55:18.238070) 13:55:18.731317 run osmo-nitb_10.42.42.2(pid=16142): stderr: | (launched: 2022-12-10_13:55:18.285543) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:55:18.863642 run osmo-nitb_10.42.42.2(pid=16142): stdout: | (launched: 2022-12-10_13:55:18.238070) 13:55:18.989924 run osmo-nitb_10.42.42.2(pid=16142): stderr: | (launched: 2022-12-10_13:55:18.285543) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:55:19.140724 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=16142): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16142) [trial-2375↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16142)] [trial-2375↪nitb_smpp↪esme_connect_policy_closed.py:24] 13:55:19.149633 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 13:55:19.156413 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16141): Terminating (SIGTERM) 13:55:19.367055 --- ParallelTerminationStrategy: PID 16141 died... 13:55:19.388122 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16141): Terminated: ok {rc=0} ---------------------------------------------- trial-2375 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 13:55:19.438874 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 13:55:19.450337 tst nitb_smpp: Using 1 x bts (candidates: 1) 13:55:19.486805 tst esme_ms_sms_storeforward.py: using LAC 28859 13:55:19.614121 tst esme_ms_sms_storeforward.py: using RAC 44 13:55:19.741359 tst esme_ms_sms_storeforward.py: using CellId 28859 13:55:19.867388 tst esme_ms_sms_storeforward.py: using BVCI 28860 13:55:19.983535 tst nitb_smpp: Using 1 x modem (candidates: 1) 13:55:20.108229 tst esme_ms_sms_storeforward.py: using MSISDN 7768 13:55:20.225972 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 13:55:20.442743 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:55:21.093404 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16143): Launched 13:55:21.412833 run osmo-nitb_10.42.42.2(pid=16144): Launched 13:55:21.584794 run osmo-nitb_10.42.42.2(pid=16144): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16144)] 13:55:21.716677 run osmo-nitb_10.42.42.2(pid=16144): stdout: | (launched: 2022-12-10_13:55:21.354755) 13:55:21.849837 run osmo-nitb_10.42.42.2(pid=16144): stderr: | (launched: 2022-12-10_13:55:21.403000) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:55:21.983089 run osmo-nitb_10.42.42.2(pid=16144): stdout: | (launched: 2022-12-10_13:55:21.354755) 13:55:22.110002 run osmo-nitb_10.42.42.2(pid=16144): stderr: | (launched: 2022-12-10_13:55:21.403000) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:55:22.261521 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=16144): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16144) [trial-2375↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16144)] [trial-2375↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 13:55:22.270257 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 13:55:22.277151 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16143): Terminating (SIGTERM) 13:55:22.488063 --- ParallelTerminationStrategy: PID 16143 died... 13:55:22.509160 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16143): Terminated: ok {rc=0} 13:55:22.595222 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 13:55:23.683763 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 13:55:23.695059 tst nitb_smpp: Using 1 x bts (candidates: 1) 13:55:23.732714 tst esme_ms_sms_transaction.py: using LAC 28860 13:55:23.863599 tst esme_ms_sms_transaction.py: using RAC 45 13:55:23.987719 tst esme_ms_sms_transaction.py: using CellId 28860 13:55:24.106304 tst esme_ms_sms_transaction.py: using BVCI 28861 13:55:24.214656 tst nitb_smpp: Using 1 x modem (candidates: 1) 13:55:24.341747 tst esme_ms_sms_transaction.py: using MSISDN 7769 13:55:24.451758 tst esme_ms_sms_transaction.py:18: start nitb and bts... 13:55:24.652833 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:55:25.258734 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16145): Launched 13:55:25.556786 run osmo-nitb_10.42.42.2(pid=16146): Launched 13:55:25.721759 run osmo-nitb_10.42.42.2(pid=16146): ERR: Terminated: ERROR {rc=2} [trial-2375↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16146)] 13:55:25.856443 run osmo-nitb_10.42.42.2(pid=16146): stdout: | (launched: 2022-12-10_13:55:25.502609) 13:55:25.991973 run osmo-nitb_10.42.42.2(pid=16146): stderr: | (launched: 2022-12-10_13:55:25.547283) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:55:26.128152 run osmo-nitb_10.42.42.2(pid=16146): stdout: | (launched: 2022-12-10_13:55:25.502609) 13:55:26.258256 run osmo-nitb_10.42.42.2(pid=16146): stderr: | (launched: 2022-12-10_13:55:25.547283) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9434386268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16146) [trial-2375↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16146)] 13:55:26.669104 tst osmo-nitb_10.42.42.2(pid=16146): stdout: | (launched: 2022-12-10_13:55:25.502609) 13:55:26.790493 tst osmo-nitb_10.42.42.2(pid=16146): stderr: | (launched: 2022-12-10_13:55:25.547283) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:55:26.933054 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=16146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16146) [trial-2375↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16146)] [trial-2375↪nitb_smpp↪esme_ms_sms_transaction.py:21] 13:55:26.941542 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 13:55:26.948037 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16145): Terminating (SIGTERM) 13:55:27.156042 --- ParallelTerminationStrategy: PID 16145 died... 13:55:27.176322 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16145): Terminated: ok {rc=0} 13:55:27.261538 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 smpp --------------------------------------------------------------------- 13:55:28.424193 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:55:28.427218 tst smpp: Verifying 1 x bts (candidates: 11) 13:55:28.447668 tst smpp: Verifying 6 x ip_address (candidates: 9) 13:55:28.474426 tst smpp: Verifying 1 x modem (candidates: 12) 13:55:28.510277 tst smpp: Reserving 1 x bts (candidates: 11) 13:55:28.532460 tst smpp: Reserving 6 x ip_address (candidates: 9) 13:55:28.559889 tst smpp: Reserving 1 x modem (candidates: 12) 13:55:29.081856 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2375 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 13:55:29.087588 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:29.098449 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:29.109070 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:29.119566 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:29.138069 tst esme_connect_policy_acceptall.py: using MSISDN 7770 13:55:29.247906 run osmo-stp_10.42.42.4: Starting osmo-stp 13:55:29.756684 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16150): Launched 13:55:30.054176 run osmo-stp_10.42.42.4(pid=16151): Launched 13:55:30.168480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:30.633740 run create_hlr_db(pid=16152): Launched 13:55:30.755966 bus /sierra_2: Setting Powered False 13:55:31.814875 run create_hlr_db(pid=16152): Terminated: ok {rc=0} 13:55:32.240762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16154): Launched 13:55:32.549064 run osmo-hlr_10.42.42.2(pid=16155): Launched 13:55:32.663951 run osmo-msc_10.42.42.5: Starting osmo-msc 13:55:33.206423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16157): Launched 13:55:33.505363 run osmo-msc_10.42.42.5(pid=16158): Launched 13:55:33.673668 run osmo-hlr_10.42.42.2(pid=16155): ERR: Terminated: ERROR {rc=237} [trial-2375↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16155)] 13:55:33.802081 run osmo-hlr_10.42.42.2(pid=16155): stdout: | (launched: 2022-12-10_13:55:32.494192) 13:55:33.929891 run osmo-hlr_10.42.42.2(pid=16155): stderr: | [0;m[1;31m20221210135532673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135532673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135532673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135532673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135532673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135532673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135532685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135532694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135532694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135532695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:34.054835 run osmo-hlr_10.42.42.2(pid=16155): stdout: | (launched: 2022-12-10_13:55:32.494192) 13:55:34.174100 run osmo-hlr_10.42.42.2(pid=16155): stderr: | [0;m[1;31m20221210135532673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135532673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135532673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135532673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135532673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135532673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135532685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135532694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135532694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135532695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:34.317188 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=16155): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16155) [trial-2375↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16155)] [trial-2375↪smpp↪esme_connect_policy_acceptall.py:23] 13:55:34.325320 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.2 sec) 13:55:34.350804 run osmo-msc_10.42.42.5(pid=16158): ERR: Terminated: ERROR {rc=9} [trial-2375↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=16158)] 13:55:34.397908 run osmo-msc_10.42.42.5(pid=16158): stdout: | (launched: 2022-12-10_13:55:33.450885) 13:55:34.446608 run osmo-msc_10.42.42.5(pid=16158): stderr: | [0;m[38;5;43m20221210135533771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221210135533771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221210135533771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221210135533771 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221210135533771 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221210135533772 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221210135533772 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221210135533772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210135533772 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 13:55:34.495498 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16150): Terminating (SIGTERM) 13:55:34.534023 run osmo-stp_10.42.42.4(pid=16151): Terminating (SIGTERM) 13:55:34.572558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16154): Terminating (SIGTERM) 13:55:34.612587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16157): Terminating (SIGTERM) 13:55:34.652755 --- ParallelTerminationStrategy: PID 16150 died... 13:55:34.671905 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16150): Terminated: ok {rc=0} 13:55:34.716151 --- ParallelTerminationStrategy: PID 16151 died... 13:55:34.734555 run osmo-stp_10.42.42.4(pid=16151): Terminated: ok {rc=0} 13:55:34.778055 --- ParallelTerminationStrategy: PID 16154 died... 13:55:34.796407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16154): Terminated: ok {rc=0} 13:55:34.839990 --- ParallelTerminationStrategy: PID 16157 died... 13:55:34.858346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16157): Terminated: ok {rc=0} ---------------------------------------------- trial-2375 smpp esme_connect_policy_closed.py ---------------------------------------------- 13:55:34.906492 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:34.917217 tst smpp: Using 1 x bts (candidates: 1) 13:55:34.952566 tst esme_connect_policy_closed.py: using LAC 28861 13:55:35.073281 tst esme_connect_policy_closed.py: using RAC 46 13:55:35.200082 tst esme_connect_policy_closed.py: using CellId 28861 13:55:35.328118 tst esme_connect_policy_closed.py: using BVCI 28862 13:55:35.446990 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:35.457777 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:35.468281 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:35.488063 tst esme_connect_policy_closed.py: using MSISDN 7771 13:55:35.613993 tst esme_connect_policy_closed.py: using MSISDN 7772 13:55:35.731956 run osmo-stp_10.42.42.4: Starting osmo-stp 13:55:36.276368 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16161): Launched 13:55:36.595268 run osmo-stp_10.42.42.4(pid=16162): Launched 13:55:36.717933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:37.213135 run create_hlr_db(pid=16163): Launched 13:55:38.391485 run create_hlr_db(pid=16163): Terminated: ok {rc=0} 13:55:38.728924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16165): Launched 13:55:39.047990 run osmo-hlr_10.42.42.2(pid=16166): Launched 13:55:39.170647 run osmo-msc_10.42.42.5: Starting osmo-msc 13:55:39.749669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16168): Launched 13:55:40.069650 run osmo-msc_10.42.42.5(pid=16169): Launched 13:55:40.249201 run osmo-hlr_10.42.42.2(pid=16166): ERR: Terminated: ERROR {rc=237} [trial-2375↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16166)] 13:55:40.385462 run osmo-hlr_10.42.42.2(pid=16166): stdout: | (launched: 2022-12-10_13:55:38.990083) 13:55:40.523036 run osmo-hlr_10.42.42.2(pid=16166): stderr: | [0;m[1;31m20221210135539187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135539188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135539188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135539188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135539188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135539188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135539200 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135539208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135539209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135539209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:40.659881 run osmo-hlr_10.42.42.2(pid=16166): stdout: | (launched: 2022-12-10_13:55:38.990083) 13:55:40.787614 run osmo-hlr_10.42.42.2(pid=16166): stderr: | [0;m[1;31m20221210135539187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135539188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135539188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135539188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135539188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135539188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135539200 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135539208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135539209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135539209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:40.940482 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=16166): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16166) [trial-2375↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16166)] [trial-2375↪smpp↪esme_connect_policy_closed.py:31] 13:55:40.949296 tst esme_connect_policy_closed.py:31: Test FAILED (6.0 sec) 13:55:40.976636 run osmo-msc_10.42.42.5(pid=16169): ERR: Terminated: ERROR {rc=9} [trial-2375↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=16169)] 13:55:41.026476 run osmo-msc_10.42.42.5(pid=16169): stdout: | (launched: 2022-12-10_13:55:40.011741) 13:55:41.078201 run osmo-msc_10.42.42.5(pid=16169): stderr: | [0;m[38;5;43m20221210135540374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221210135540374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221210135540374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221210135540374 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221210135540374 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221210135540374 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221210135540374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221210135540375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210135540375 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 13:55:41.130374 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16161): Terminating (SIGTERM) 13:55:41.171816 run osmo-stp_10.42.42.4(pid=16162): Terminating (SIGTERM) 13:55:41.213801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16165): Terminating (SIGTERM) 13:55:41.257274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16168): Terminating (SIGTERM) 13:55:41.300893 --- ParallelTerminationStrategy: PID 16161 died... 13:55:41.321283 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16161): Terminated: ok {rc=0} 13:55:41.369694 --- ParallelTerminationStrategy: PID 16162 died... 13:55:41.389021 run osmo-stp_10.42.42.4(pid=16162): Terminated: ok {rc=0} 13:55:41.435360 --- ParallelTerminationStrategy: PID 16165 died... 13:55:41.454575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16165): Terminated: ok {rc=0} 13:55:41.500726 --- ParallelTerminationStrategy: PID 16168 died... 13:55:41.520051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16168): Terminated: ok {rc=0} ---------------------------------------------- trial-2375 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 13:55:41.570779 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:41.582050 tst smpp: Using 1 x bts (candidates: 1) 13:55:41.618612 tst esme_ms_sms_storeforward.py: using LAC 28862 13:55:41.744918 tst esme_ms_sms_storeforward.py: using RAC 47 13:55:41.871692 tst esme_ms_sms_storeforward.py: using CellId 28862 13:55:42.012827 tst esme_ms_sms_storeforward.py: using BVCI 28863 13:55:42.122276 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:42.132716 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:42.143055 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:42.153572 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:42.163964 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:42.174389 tst smpp: Using 1 x modem (candidates: 1) 13:55:42.303056 tst esme_ms_sms_storeforward.py: using MSISDN 7773 13:55:42.421338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:42.919142 run create_hlr_db(pid=16172): Launched 13:55:44.098841 run create_hlr_db(pid=16172): Terminated: ok {rc=0} 13:55:44.437662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16174): Launched 13:55:44.756728 run osmo-hlr_10.42.42.2(pid=16175): Launched 13:55:44.880026 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:45.440305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16177): Launched 13:55:45.761128 run osmo-stp_10.42.42.5(pid=16178): Launched 13:55:45.967576 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:46.643424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16180): Launched 13:55:46.975040 run osmo-msc_10.42.42.6(pid=16181): Launched 13:55:47.322044 run osmo-stp_10.42.42.5(pid=16178): ERR: Terminated: ERROR {rc=1} [trial-2375↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16178)] 13:55:47.481959 run osmo-stp_10.42.42.5(pid=16178): stdout: | (launched: 2022-12-10_13:55:45.703309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:47.619473 run osmo-stp_10.42.42.5(pid=16178): stderr: | [0;m[38;5;43m20221210135545900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135545900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135545907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135545908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135545908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135545908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135545908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:47.747835 run osmo-stp_10.42.42.5(pid=16178): stdout: | (launched: 2022-12-10_13:55:45.703309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:47.867603 run osmo-stp_10.42.42.5(pid=16178): stderr: | [0;m[38;5;43m20221210135545900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135545900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135545907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135545908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135545908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135545908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135545908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:48.010477 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=16178): Process ended prematurely: osmo-stp_10.42.42.5(pid=16178) [trial-2375↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16178)] [trial-2375↪smpp↪esme_ms_sms_storeforward.py:30] 13:55:48.018866 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.4 sec) 13:55:48.045070 run osmo-hlr_10.42.42.2(pid=16175): ERR: Terminated: ERROR {rc=237} [trial-2375↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16175)] 13:55:48.093207 run osmo-hlr_10.42.42.2(pid=16175): stdout: | (launched: 2022-12-10_13:55:44.699141) 13:55:48.142753 run osmo-hlr_10.42.42.2(pid=16175): stderr: | [0;m[1;31m20221210135544895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135544895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135544895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135544895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135544895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135544895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135544907 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135544915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135544916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135544916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:48.211697 run osmo-msc_10.42.42.6(pid=16181): ERR: Terminated: ERROR {rc=2} [trial-2375↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16181)] 13:55:48.259137 run osmo-msc_10.42.42.6(pid=16181): stdout: | (launched: 2022-12-10_13:55:46.915439) 13:55:48.308064 run osmo-msc_10.42.42.6(pid=16181): stderr: | [0;m[38;5;43m20221210135547520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135547520 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1449d27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135547520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135547520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135547520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135547521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135547522 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135547523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135547523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135547523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:48.357742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16174): Terminating (SIGTERM) 13:55:48.397283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16177): Terminating (SIGTERM) 13:55:48.437271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16180): Terminating (SIGTERM) 13:55:48.477916 --- ParallelTerminationStrategy: PID 16174 died... 13:55:48.497107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16174): Terminated: ok {rc=0} 13:55:48.541513 --- ParallelTerminationStrategy: PID 16177 died... 13:55:48.560134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16177): Terminated: ok {rc=0} 13:55:48.604335 --- ParallelTerminationStrategy: PID 16180 died... 13:55:48.623053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16180): Terminated: ok {rc=0} 13:55:48.708941 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 smpp esme_ms_sms_transaction.py ---------------------------------------------- 13:55:49.796397 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:49.807500 tst smpp: Using 1 x bts (candidates: 1) 13:55:49.842639 tst esme_ms_sms_transaction.py: using LAC 28863 13:55:49.960483 tst esme_ms_sms_transaction.py: using RAC 48 13:55:50.081453 tst esme_ms_sms_transaction.py: using CellId 28863 13:55:50.198280 tst esme_ms_sms_transaction.py: using BVCI 28864 13:55:50.306125 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:50.316286 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:50.326375 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:50.336365 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:50.346403 tst smpp: Using 1 x ip_address (candidates: 6) 13:55:50.356344 tst smpp: Using 1 x modem (candidates: 1) 13:55:50.480921 tst esme_ms_sms_transaction.py: using MSISDN 7774 13:55:50.597674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:51.104631 run create_hlr_db(pid=16183): Launched 13:55:51.226515 bus /sierra_2: Setting Powered False 13:55:52.289804 run create_hlr_db(pid=16183): Terminated: ok {rc=0} 13:55:52.719993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16185): Launched 13:55:53.020265 run osmo-hlr_10.42.42.2(pid=16186): Launched 13:55:53.135807 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:53.669469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16188): Launched 13:55:53.968848 run osmo-stp_10.42.42.5(pid=16189): Launched 13:55:54.083149 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:54.623191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16191): Launched 13:55:54.923119 run osmo-msc_10.42.42.6(pid=16192): Launched 13:55:55.092017 run osmo-stp_10.42.42.5(pid=16189): ERR: Terminated: ERROR {rc=1} [trial-2375↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16189)] 13:55:55.220491 run osmo-stp_10.42.42.5(pid=16189): stdout: | (launched: 2022-12-10_13:55:53.914312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:55.347995 run osmo-stp_10.42.42.5(pid=16189): stderr: | [0;m[38;5;43m20221210135554084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135554084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135554084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135554085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135554085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135554085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135554085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:55.473425 run osmo-stp_10.42.42.5(pid=16189): stdout: | (launched: 2022-12-10_13:55:53.914312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:55.592424 run osmo-stp_10.42.42.5(pid=16189): stderr: | [0;m[38;5;43m20221210135554084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135554084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135554084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135554085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135554085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135554085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135554085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:55.734786 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=16189): Process ended prematurely: osmo-stp_10.42.42.5(pid=16189) [trial-2375↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16189)] [trial-2375↪smpp↪esme_ms_sms_transaction.py:28] 13:55:55.743115 tst esme_ms_sms_transaction.py:28: Test FAILED (5.9 sec) 13:55:55.768761 run osmo-hlr_10.42.42.2(pid=16186): ERR: Terminated: ERROR {rc=237} [trial-2375↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16186)] 13:55:55.816139 run osmo-hlr_10.42.42.2(pid=16186): stdout: | (launched: 2022-12-10_13:55:52.965594) 13:55:55.865460 run osmo-hlr_10.42.42.2(pid=16186): stderr: | [0;m[1;31m20221210135553140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135553140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135553140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135553140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135553140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135553140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135553152 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135553163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135553163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135553163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:55.933822 run osmo-msc_10.42.42.6(pid=16192): ERR: Terminated: ERROR {rc=2} [trial-2375↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16192)] 13:55:55.981364 run osmo-msc_10.42.42.6(pid=16192): stdout: | (launched: 2022-12-10_13:55:54.868335) 13:55:56.030141 run osmo-msc_10.42.42.6(pid=16192): stderr: | [0;m[38;5;43m20221210135555137 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135555137 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f57cf677c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135555138 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135555138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135555138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135555138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135555142 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135555143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135555143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135555143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:56.079237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16185): Terminating (SIGTERM) 13:55:56.118397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16188): Terminating (SIGTERM) 13:55:56.157776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16191): Terminating (SIGTERM) 13:55:56.197432 --- ParallelTerminationStrategy: PID 16185 died... 13:55:56.216282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16185): Terminated: ok {rc=0} 13:55:56.260528 --- ParallelTerminationStrategy: PID 16188 died... 13:55:56.278933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16188): Terminated: ok {rc=0} 13:55:56.322180 --- ParallelTerminationStrategy: PID 16191 died... 13:55:56.340558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16191): Terminated: ok {rc=0} 13:55:56.423231 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 encryption --------------------------------------------------------------------- 13:55:57.612118 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:55:57.615134 tst encryption: Verifying 1 x bts (candidates: 11) 13:55:57.635223 tst encryption: Verifying 6 x ip_address (candidates: 9) 13:55:57.661321 tst encryption: Verifying 1 x modem (candidates: 12) 13:55:57.695240 tst encryption: Reserving 1 x bts (candidates: 11) 13:55:57.715506 tst encryption: Reserving 6 x ip_address (candidates: 9) 13:55:57.741394 tst encryption: Reserving 1 x modem (candidates: 12) 13:55:58.269979 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2375 encryption register_a5_0_authopt.py ---------------------------------------------- 13:55:58.319955 tst encryption: Using 1 x ip_address (candidates: 6) 13:55:58.330269 tst encryption: Using 1 x bts (candidates: 1) 13:55:58.364121 tst register_a5_0_authopt.py: using LAC 28864 13:55:58.483705 tst register_a5_0_authopt.py: using RAC 49 13:55:58.604632 tst register_a5_0_authopt.py: using CellId 28864 13:55:58.727123 tst register_a5_0_authopt.py: using BVCI 28865 13:55:58.839096 tst encryption: Using 1 x ip_address (candidates: 6) 13:55:58.849376 tst encryption: Using 1 x ip_address (candidates: 6) 13:55:58.859899 tst encryption: Using 1 x ip_address (candidates: 6) 13:55:58.870046 tst encryption: Using 1 x ip_address (candidates: 6) 13:55:58.880242 tst encryption: Using 1 x ip_address (candidates: 6) 13:55:58.890329 tst encryption: Using 1 x modem (candidates: 1) 13:55:59.008039 tst register_a5_0_authopt.py:8: start network... 13:55:59.227444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:59.730967 run create_hlr_db(pid=16197): Launched 13:55:59.854731 bus /sierra_2: Setting Powered False 13:56:00.935290 run create_hlr_db(pid=16197): Terminated: ok {rc=0} 13:56:01.407541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16199): Launched 13:56:01.776027 run osmo-hlr_10.42.42.2(pid=16200): Launched 13:56:02.024203 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:02.641025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16202): Launched 13:56:02.963192 run osmo-stp_10.42.42.5(pid=16203): Launched 13:56:03.087169 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:03.671274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16205): Launched 13:56:03.994894 run osmo-msc_10.42.42.6(pid=16206): Launched 13:56:04.176016 run osmo-stp_10.42.42.5(pid=16203): ERR: Terminated: ERROR {rc=1} [trial-2375↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16203)] 13:56:04.313921 run osmo-stp_10.42.42.5(pid=16203): stdout: | (launched: 2022-12-10_13:56:02.904788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:04.451802 run osmo-stp_10.42.42.5(pid=16203): stderr: | [0;m[38;5;43m20221210135603095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135603096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135603096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135603096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135603097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135603097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135603097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:04.588541 run osmo-stp_10.42.42.5(pid=16203): stdout: | (launched: 2022-12-10_13:56:02.904788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:04.717570 run osmo-stp_10.42.42.5(pid=16203): stderr: | [0;m[38;5;43m20221210135603095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135603096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135603096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135603096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135603097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135603097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135603097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:04.871886 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16203): Process ended prematurely: osmo-stp_10.42.42.5(pid=16203) [trial-2375↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16203)] [trial-2375↪encryption↪register_a5_0_authopt.py:8] 13:56:04.881578 tst register_a5_0_authopt.py:8: Test FAILED (6.6 sec) 13:56:04.909358 run osmo-hlr_10.42.42.2(pid=16200): ERR: Terminated: ERROR {rc=237} [trial-2375↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16200)] 13:56:04.959754 run osmo-hlr_10.42.42.2(pid=16200): stdout: | (launched: 2022-12-10_13:56:01.707414) 13:56:05.011424 run osmo-hlr_10.42.42.2(pid=16200): stderr: | [0;m[1;31m20221210135602015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135602015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135602015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135602015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135602015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135602015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135602036 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135602044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135602045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135602045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:05.083606 run osmo-msc_10.42.42.6(pid=16206): ERR: Terminated: ERROR {rc=2} [trial-2375↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16206)] 13:56:05.133494 run osmo-msc_10.42.42.6(pid=16206): stdout: | (launched: 2022-12-10_13:56:03.936251) 13:56:05.184937 run osmo-msc_10.42.42.6(pid=16206): stderr: | [0;m[38;5;43m20221210135604257 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135604257 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f08d3a9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135604257 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135604257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135604258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135604258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135604259 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135604260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135604260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135604260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:05.236805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16199): Terminating (SIGTERM) 13:56:05.278552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16202): Terminating (SIGTERM) 13:56:05.320496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16205): Terminating (SIGTERM) 13:56:05.362904 --- ParallelTerminationStrategy: PID 16199 died... 13:56:05.382703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16199): Terminated: ok {rc=0} 13:56:05.429483 --- ParallelTerminationStrategy: PID 16202 died... 13:56:05.448842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16202): Terminated: ok {rc=0} 13:56:05.495171 --- ParallelTerminationStrategy: PID 16205 died... 13:56:05.514613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16205): Terminated: ok {rc=0} 13:56:05.602701 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 encryption register_a5_0_authreq.py ---------------------------------------------- 13:56:06.746573 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:06.757531 tst encryption: Using 1 x bts (candidates: 1) 13:56:06.791983 tst register_a5_0_authreq.py: using LAC 28865 13:56:06.920862 tst register_a5_0_authreq.py: using RAC 50 13:56:07.050176 tst register_a5_0_authreq.py: using CellId 28865 13:56:07.177445 tst register_a5_0_authreq.py: using BVCI 28866 13:56:07.297518 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:07.308270 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:07.318938 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:07.329815 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:07.340566 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:07.351080 tst encryption: Using 1 x modem (candidates: 1) 13:56:07.473971 tst register_a5_0_authreq.py:8: start network... 13:56:07.693526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:08.194480 run create_hlr_db(pid=16208): Launched 13:56:08.317756 bus /sierra_2: Setting Powered False 13:56:09.381773 run create_hlr_db(pid=16208): Terminated: ok {rc=0} 13:56:09.830194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16210): Launched 13:56:10.153237 run osmo-hlr_10.42.42.2(pid=16211): Launched 13:56:10.277624 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:10.837624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16213): Launched 13:56:11.162407 run osmo-stp_10.42.42.5(pid=16214): Launched 13:56:11.286387 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:11.871878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16216): Launched 13:56:12.195967 run osmo-msc_10.42.42.6(pid=16217): Launched 13:56:12.377325 run osmo-stp_10.42.42.5(pid=16214): ERR: Terminated: ERROR {rc=1} [trial-2375↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16214)] 13:56:12.515466 run osmo-stp_10.42.42.5(pid=16214): stdout: | (launched: 2022-12-10_13:56:11.102893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:12.653189 run osmo-stp_10.42.42.5(pid=16214): stderr: | [0;m[38;5;43m20221210135611296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135611296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135611296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135611297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135611297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135611297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135611298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:12.789685 run osmo-stp_10.42.42.5(pid=16214): stdout: | (launched: 2022-12-10_13:56:11.102893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:12.918706 run osmo-stp_10.42.42.5(pid=16214): stderr: | [0;m[38;5;43m20221210135611296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135611296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135611296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135611297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135611297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135611297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135611298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:13.073338 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16214): Process ended prematurely: osmo-stp_10.42.42.5(pid=16214) [trial-2375↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16214)] [trial-2375↪encryption↪register_a5_0_authreq.py:8] 13:56:13.082757 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 13:56:13.110716 run osmo-hlr_10.42.42.2(pid=16211): ERR: Terminated: ERROR {rc=237} [trial-2375↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16211)] 13:56:13.160126 run osmo-hlr_10.42.42.2(pid=16211): stdout: | (launched: 2022-12-10_13:56:10.094954) 13:56:13.211417 run osmo-hlr_10.42.42.2(pid=16211): stderr: | [0;m[1;31m20221210135610291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135610291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135610291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135610291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135610291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135610291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135610303 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135610312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135610312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135610312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:13.283007 run osmo-msc_10.42.42.6(pid=16217): ERR: Terminated: ERROR {rc=2} [trial-2375↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16217)] 13:56:13.332871 run osmo-msc_10.42.42.6(pid=16217): stdout: | (launched: 2022-12-10_13:56:12.137485) 13:56:13.384346 run osmo-msc_10.42.42.6(pid=16217): stderr: | [0;m[38;5;43m20221210135612459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135612459 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9ac106dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135612459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135612459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135612459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135612460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135612461 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135612462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135612462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135612462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:13.436499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16210): Terminating (SIGTERM) 13:56:13.478255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16213): Terminating (SIGTERM) 13:56:13.520217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16216): Terminating (SIGTERM) 13:56:13.562465 --- ParallelTerminationStrategy: PID 16210 died... 13:56:13.582232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16210): Terminated: ok {rc=0} 13:56:13.628708 --- ParallelTerminationStrategy: PID 16213 died... 13:56:13.648134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16213): Terminated: ok {rc=0} 13:56:13.694352 --- ParallelTerminationStrategy: PID 16216 died... 13:56:13.713759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16216): Terminated: ok {rc=0} 13:56:13.801946 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 encryption register_a5_1_authreq.py ---------------------------------------------- 13:56:14.953126 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:14.964619 tst encryption: Using 1 x bts (candidates: 1) 13:56:15.007303 tst register_a5_1_authreq.py: using LAC 28866 13:56:15.145584 tst register_a5_1_authreq.py: using RAC 51 13:56:15.275565 tst register_a5_1_authreq.py: using CellId 28866 13:56:15.404148 tst register_a5_1_authreq.py: using BVCI 28867 13:56:15.522957 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:15.533782 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:15.544473 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:15.555425 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:15.566338 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:15.577130 tst encryption: Using 1 x modem (candidates: 1) 13:56:15.695969 tst register_a5_1_authreq.py:8: start network... 13:56:15.939564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:16.456226 run create_hlr_db(pid=16219): Launched 13:56:16.583253 bus /sierra_2: Setting Powered False 13:56:17.642478 run create_hlr_db(pid=16219): Terminated: ok {rc=0} 13:56:18.098314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16221): Launched 13:56:18.421897 run osmo-hlr_10.42.42.2(pid=16222): Launched 13:56:18.547614 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:19.107814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16224): Launched 13:56:19.432363 run osmo-stp_10.42.42.5(pid=16225): Launched 13:56:19.557774 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:20.143568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16227): Launched 13:56:20.451766 run osmo-msc_10.42.42.6(pid=16228): Launched 13:56:20.623475 run osmo-stp_10.42.42.5(pid=16225): ERR: Terminated: ERROR {rc=1} [trial-2375↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16225)] 13:56:20.755180 run osmo-stp_10.42.42.5(pid=16225): stdout: | (launched: 2022-12-10_13:56:19.373580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:20.883577 run osmo-stp_10.42.42.5(pid=16225): stderr: | [0;m[38;5;43m20221210135619565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135619565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135619566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135619566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135619566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135619566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135619567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:21.010463 run osmo-stp_10.42.42.5(pid=16225): stdout: | (launched: 2022-12-10_13:56:19.373580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:21.131952 run osmo-stp_10.42.42.5(pid=16225): stderr: | [0;m[38;5;43m20221210135619565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135619565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135619566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135619566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135619566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135619566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135619567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:21.276294 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16225): Process ended prematurely: osmo-stp_10.42.42.5(pid=16225) [trial-2375↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16225)] [trial-2375↪encryption↪register_a5_1_authreq.py:8] 13:56:21.285227 tst register_a5_1_authreq.py:8: Test FAILED (6.4 sec) 13:56:21.311632 run osmo-hlr_10.42.42.2(pid=16222): ERR: Terminated: ERROR {rc=237} [trial-2375↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16222)] 13:56:21.359541 run osmo-hlr_10.42.42.2(pid=16222): stdout: | (launched: 2022-12-10_13:56:18.363130) 13:56:21.408266 run osmo-hlr_10.42.42.2(pid=16222): stderr: | [0;m[1;31m20221210135618559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135618559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135618559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135618559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135618559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135618559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135618571 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135618580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135618580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135618580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:21.476616 run osmo-msc_10.42.42.6(pid=16228): ERR: Terminated: ERROR {rc=2} [trial-2375↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16228)] 13:56:21.523853 run osmo-msc_10.42.42.6(pid=16228): stdout: | (launched: 2022-12-10_13:56:20.396337) 13:56:21.572427 run osmo-msc_10.42.42.6(pid=16228): stderr: | [0;m[38;5;43m20221210135620668 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135620669 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7de350bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135620669 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135620669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135620669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135620669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135620671 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135620671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135620671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135620671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:21.621482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16221): Terminating (SIGTERM) 13:56:21.660654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16224): Terminating (SIGTERM) 13:56:21.700235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16227): Terminating (SIGTERM) 13:56:21.739796 --- ParallelTerminationStrategy: PID 16221 died... 13:56:21.758635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16221): Terminated: ok {rc=0} 13:56:21.802663 --- ParallelTerminationStrategy: PID 16224 died... 13:56:21.821160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16224): Terminated: ok {rc=0} 13:56:21.864731 --- ParallelTerminationStrategy: PID 16227 died... 13:56:21.883311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16227): Terminated: ok {rc=0} 13:56:21.968041 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2375 encryption register_a5_3_authreq.py ---------------------------------------------- 13:56:23.115770 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:23.126928 tst encryption: Using 1 x bts (candidates: 1) 13:56:23.162359 tst register_a5_3_authreq.py: using LAC 28867 13:56:23.283014 tst register_a5_3_authreq.py: using RAC 52 13:56:23.404905 tst register_a5_3_authreq.py: using CellId 28867 13:56:23.526373 tst register_a5_3_authreq.py: using BVCI 28868 13:56:23.647186 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:23.658030 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:23.668725 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:23.680115 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:23.691426 tst encryption: Using 1 x ip_address (candidates: 6) 13:56:23.702646 tst encryption: Using 1 x modem (candidates: 1) 13:56:23.829140 tst register_a5_3_authreq.py:8: start network... 13:56:24.034572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:24.505470 run create_hlr_db(pid=16230): Launched 13:56:24.629893 bus /sierra_2: Setting Powered False 13:56:25.689961 run create_hlr_db(pid=16230): Terminated: ok {rc=0} 13:56:26.111677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16232): Launched 13:56:26.414835 run osmo-hlr_10.42.42.2(pid=16233): Launched 13:56:26.530355 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:27.049852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16235): Launched 13:56:27.352473 run osmo-stp_10.42.42.5(pid=16236): Launched 13:56:27.468290 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:28.019569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16238): Launched 13:56:28.322721 run osmo-msc_10.42.42.6(pid=16239): Launched 13:56:28.492179 run osmo-stp_10.42.42.5(pid=16236): ERR: Terminated: ERROR {rc=1} [trial-2375↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16236)] 13:56:28.621470 run osmo-stp_10.42.42.5(pid=16236): stdout: | (launched: 2022-12-10_13:56:27.297307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:28.749578 run osmo-stp_10.42.42.5(pid=16236): stderr: | [0;m[38;5;43m20221210135627466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135627466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135627467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135627467 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135627469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135627469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135627469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:28.875648 run osmo-stp_10.42.42.5(pid=16236): stdout: | (launched: 2022-12-10_13:56:27.297307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:28.996225 run osmo-stp_10.42.42.5(pid=16236): stderr: | [0;m[38;5;43m20221210135627466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135627466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135627467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135627467 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135627469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135627469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135627469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:29.141364 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16236): Process ended prematurely: osmo-stp_10.42.42.5(pid=16236) [trial-2375↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16236)] [trial-2375↪encryption↪register_a5_3_authreq.py:8] 13:56:29.150082 tst register_a5_3_authreq.py:8: Test FAILED (6.1 sec) 13:56:29.175547 run osmo-hlr_10.42.42.2(pid=16233): ERR: Terminated: ERROR {rc=237} [trial-2375↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16233)] 13:56:29.222380 run osmo-hlr_10.42.42.2(pid=16233): stdout: | (launched: 2022-12-10_13:56:26.359666) 13:56:29.270898 run osmo-hlr_10.42.42.2(pid=16233): stderr: | [0;m[1;31m20221210135626535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135626535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135626535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135626535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135626535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135626535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135626550 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135626559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135626559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135626560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:29.338490 run osmo-msc_10.42.42.6(pid=16239): ERR: Terminated: ERROR {rc=2} [trial-2375↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16239)] 13:56:29.385303 run osmo-msc_10.42.42.6(pid=16239): stdout: | (launched: 2022-12-10_13:56:28.267401) 13:56:29.433662 run osmo-msc_10.42.42.6(pid=16239): stderr: | [0;m[38;5;43m20221210135628541 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135628541 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc95d08dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135628541 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135628541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135628541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135628541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135628543 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135628543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135628544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135628544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:29.482289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16232): Terminating (SIGTERM) 13:56:29.521121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16235): Terminating (SIGTERM) 13:56:29.560154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16238): Terminating (SIGTERM) 13:56:29.599348 --- ParallelTerminationStrategy: PID 16232 died... 13:56:29.618380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16232): Terminated: ok {rc=0} 13:56:29.661446 --- ParallelTerminationStrategy: PID 16235 died... 13:56:29.679680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16235): Terminated: ok {rc=0} 13:56:29.722715 --- ParallelTerminationStrategy: PID 16238 died... 13:56:29.741040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16238): Terminated: ok {rc=0} 13:56:29.823131 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 13:56:31.047117 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:56:31.055246 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 13:56:31.083169 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 13:56:31.117390 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 13:56:31.152357 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 13:56:31.171498 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 13:56:31.201103 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 13:56:31.706651 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2375 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 13:56:31.713380 tst handover.py:11: TEST_CONFIG: {} 13:56:31.942123 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 13:56:31.959743 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 13:56:31.990150 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 13:56:32.044683 tst handover.py: using MSISDN 7775 13:56:32.160528 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7775', subscriber_id=0} 13:56:32.269557 run srsepc_10.42.42.118: Starting srsepc 13:56:34.082648 run rm-remote-dir(pid=16244): Launched 13:56:34.204230 bus /sierra_2: Setting Powered False 13:56:35.269023 run rm-remote-dir(pid=16244): Terminated: ok {rc=0} 13:56:35.723413 run mk-remote-dir(pid=16245): Launched 13:56:36.910263 run mk-remote-dir(pid=16245): Terminated: ok {rc=0} 13:56:37.215207 run scp-inst-to-remote(pid=16246): Launched 13:56:39.398347 run scp-inst-to-remote(pid=16246): Terminated: ok {rc=0} 13:56:39.726566 run rm-remote-dir(pid=16248): Launched 13:56:40.903363 run rm-remote-dir(pid=16248): Terminated: ok {rc=0} 13:56:41.233736 run mk-remote-dir(pid=16249): Launched 13:56:42.415682 run mk-remote-dir(pid=16249): Terminated: ok {rc=0} 13:56:42.697700 run scp-cfg-to-remote(pid=16250): Launched 13:56:43.873228 run scp-cfg-to-remote(pid=16250): Terminated: ok {rc=0} 13:56:44.153251 run scp-db-to-remote(pid=16252): Launched 13:56:45.328922 run scp-db-to-remote(pid=16252): Terminated: ok {rc=0} 13:56:45.458434 run srsepc_10.42.42.118: Setting RPATH for srsepc 13:56:45.761581 run patchelf(pid=16254): Launched 13:56:46.986362 run patchelf(pid=16254): Terminated: ok {rc=0} 13:56:47.133555 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 13:56:47.465336 run setcap-netadm(pid=16255): Launched 13:56:48.651108 run setcap-netadm(pid=16255): Terminated: ok {rc=0} 13:56:48.992288 run srsepc(pid=16256): Launched 13:56:49.112063 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 13:56:50.274102 run rm-remote-dir(pid=16257): Launched 13:56:50.458340 run srsepc(pid=16256): ERR: Terminated: ERROR {rc=127} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16256)] 13:56:50.599698 run srsepc(pid=16256): stdout: | (launched: 2022-12-10_13:56:48.932633) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:56:50.741831 run srsepc(pid=16256): stderr: | (launched: 2022-12-10_13:56:48.980889) | Connection to 10.42.42.116 closed. 13:56:50.883675 run srsepc(pid=16256): stdout: | (launched: 2022-12-10_13:56:48.932633) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:56:51.019616 run srsepc(pid=16256): stderr: | (launched: 2022-12-10_13:56:48.980889) | Connection to 10.42.42.116 closed. 13:56:51.180437 run rm-remote-dir(pid=16257): Terminating (SIGINT) 13:56:51.367395 run rm-remote-dir(pid=16257): Terminated: ok {rc=0} 13:56:51.502824 tst handover.py:37: ERR: Error: srsepc(pid=16256): Process ended prematurely: srsepc(pid=16256) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16256)] [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 13:56:51.513524 tst handover.py:37: Test FAILED (19.8 sec) 13:56:51.593058 run scp-back-log(pid=16258): Launched 13:56:52.671940 run scp-back-log(pid=16258): ERR: Terminated: ERROR {rc=1} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16258)] 13:56:52.735171 run scp-back-log(pid=16258): stdout: | (launched: 2022-12-10_13:56:51.562306) 13:56:52.799886 run scp-back-log(pid=16258): stderr: | (launched: 2022-12-10_13:56:51.582827) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 13:56:52.872927 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16258): launch_sync(): local process exited with status 1 [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16258)]') ---------------------------------------------- trial-2375 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 13:56:52.920256 tst iperf3_bidir.py:13: Number of physical ue: 1 13:56:53.138326 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 13:56:53.180683 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 13:56:53.383907 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 13:56:53.399433 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 13:56:53.431008 tst iperf3_bidir.py: using MSISDN 7776 13:56:53.543248 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7776', subscriber_id=0} 13:56:53.649455 run srsepc_10.42.42.118: Starting srsepc 13:56:54.272076 run rm-remote-dir(pid=16260): Launched 13:56:55.450454 run rm-remote-dir(pid=16260): Terminated: ok {rc=0} 13:56:55.781721 run mk-remote-dir(pid=16261): Launched 13:56:56.959105 run mk-remote-dir(pid=16261): Terminated: ok {rc=0} 13:56:57.242168 run scp-inst-to-remote(pid=16262): Launched 13:56:59.420751 run scp-inst-to-remote(pid=16262): Terminated: ok {rc=0} 13:56:59.750024 run rm-remote-dir(pid=16264): Launched 13:57:00.947892 run rm-remote-dir(pid=16264): Terminated: ok {rc=0} 13:57:01.323139 run mk-remote-dir(pid=16265): Launched 13:57:02.563446 run mk-remote-dir(pid=16265): Terminated: ok {rc=0} 13:57:02.846894 run scp-cfg-to-remote(pid=16266): Launched 13:57:04.023178 run scp-cfg-to-remote(pid=16266): Terminated: ok {rc=0} 13:57:04.303176 run scp-db-to-remote(pid=16268): Launched 13:57:05.479146 run scp-db-to-remote(pid=16268): Terminated: ok {rc=0} 13:57:05.608506 run srsepc_10.42.42.118: Setting RPATH for srsepc 13:57:05.913882 run patchelf(pid=16270): Launched 13:57:07.089623 run patchelf(pid=16270): Terminated: ok {rc=0} 13:57:07.219813 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 13:57:07.525026 run setcap-netadm(pid=16271): Launched 13:57:08.700425 run setcap-netadm(pid=16271): Terminated: ok {rc=0} 13:57:09.019314 run srsepc(pid=16272): Launched 13:57:09.133415 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 13:57:10.231229 run rm-remote-dir(pid=16273): Launched 13:57:10.406835 run srsepc(pid=16272): ERR: Terminated: ERROR {rc=127} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16272)] 13:57:10.540149 run srsepc(pid=16272): stdout: | (launched: 2022-12-10_13:57:08.964198) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:57:10.674030 run srsepc(pid=16272): stderr: | (launched: 2022-12-10_13:57:09.009567) | Connection to 10.42.42.116 closed. 13:57:10.807588 run srsepc(pid=16272): stdout: | (launched: 2022-12-10_13:57:08.964198) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:57:10.935342 run srsepc(pid=16272): stderr: | (launched: 2022-12-10_13:57:09.009567) | Connection to 10.42.42.116 closed. 13:57:11.086772 run rm-remote-dir(pid=16273): Terminating (SIGINT) 13:57:11.262375 run rm-remote-dir(pid=16273): Terminated: ok {rc=0} 13:57:11.389128 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=16272): Process ended prematurely: srsepc(pid=16272) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16272)] [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 13:57:11.398918 tst iperf3_bidir.py:42: Test FAILED (18.5 sec) 13:57:11.473889 run scp-back-log(pid=16274): Launched 13:57:12.554020 run scp-back-log(pid=16274): ERR: Terminated: ERROR {rc=1} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16274)] 13:57:12.613810 run scp-back-log(pid=16274): stdout: | (launched: 2022-12-10_13:57:11.444610) 13:57:12.675271 run scp-back-log(pid=16274): stderr: | (launched: 2022-12-10_13:57:11.464137) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 13:57:12.743998 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16274): launch_sync(): local process exited with status 1 [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16274)]') ---------------------------------------------- trial-2375 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 13:57:12.788795 tst iperf3_dl.py:13: Number of physical ue: 1 13:57:12.991130 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 13:57:13.033889 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 13:57:13.235859 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 13:57:13.251246 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 13:57:13.283666 tst iperf3_dl.py: using MSISDN 7777 13:57:13.395173 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7777', subscriber_id=0} 13:57:13.501463 run srsepc_10.42.42.118: Starting srsepc 13:57:14.123594 run rm-remote-dir(pid=16276): Launched 13:57:15.301161 run rm-remote-dir(pid=16276): Terminated: ok {rc=0} 13:57:15.632776 run mk-remote-dir(pid=16277): Launched 13:57:16.830478 run mk-remote-dir(pid=16277): Terminated: ok {rc=0} 13:57:17.153380 run scp-inst-to-remote(pid=16278): Launched 13:57:19.385583 run scp-inst-to-remote(pid=16278): Terminated: ok {rc=0} 13:57:19.714487 run rm-remote-dir(pid=16280): Launched 13:57:20.891278 run rm-remote-dir(pid=16280): Terminated: ok {rc=0} 13:57:21.225506 run mk-remote-dir(pid=16281): Launched 13:57:22.403341 run mk-remote-dir(pid=16281): Terminated: ok {rc=0} 13:57:22.686068 run scp-cfg-to-remote(pid=16282): Launched 13:57:23.861188 run scp-cfg-to-remote(pid=16282): Terminated: ok {rc=0} 13:57:24.140744 run scp-db-to-remote(pid=16284): Launched 13:57:25.316768 run scp-db-to-remote(pid=16284): Terminated: ok {rc=0} 13:57:25.445882 run srsepc_10.42.42.118: Setting RPATH for srsepc 13:57:25.750876 run patchelf(pid=16286): Launched 13:57:26.925745 run patchelf(pid=16286): Terminated: ok {rc=0} 13:57:27.056165 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 13:57:27.360696 run setcap-netadm(pid=16287): Launched 13:57:28.537050 run setcap-netadm(pid=16287): Terminated: ok {rc=0} 13:57:28.856119 run srsepc(pid=16288): Launched 13:57:28.970033 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 13:57:30.068551 run rm-remote-dir(pid=16289): Launched 13:57:30.244168 run srsepc(pid=16288): ERR: Terminated: ERROR {rc=127} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16288)] 13:57:30.378047 run srsepc(pid=16288): stdout: | (launched: 2022-12-10_13:57:28.800819) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:57:30.511805 run srsepc(pid=16288): stderr: | (launched: 2022-12-10_13:57:28.846103) | Connection to 10.42.42.116 closed. 13:57:30.645654 run srsepc(pid=16288): stdout: | (launched: 2022-12-10_13:57:28.800819) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:57:30.773795 run srsepc(pid=16288): stderr: | (launched: 2022-12-10_13:57:28.846103) | Connection to 10.42.42.116 closed. 13:57:30.950059 run rm-remote-dir(pid=16289): Terminating (SIGINT) 13:57:31.128674 run rm-remote-dir(pid=16289): Terminated: ok {rc=0} 13:57:31.258728 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=16288): Process ended prematurely: srsepc(pid=16288) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16288)] [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 13:57:31.269400 tst iperf3_dl.py:42: Test FAILED (18.5 sec) 13:57:31.358092 run scp-back-log(pid=16290): Launched 13:57:32.456904 run scp-back-log(pid=16290): ERR: Terminated: ERROR {rc=1} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16290)] 13:57:32.517442 run scp-back-log(pid=16290): stdout: | (launched: 2022-12-10_13:57:31.316740) 13:57:32.579434 run scp-back-log(pid=16290): stderr: | (launched: 2022-12-10_13:57:31.336659) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 13:57:32.649147 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16290): launch_sync(): local process exited with status 1 [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16290)]') ---------------------------------------------- trial-2375 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 13:57:32.693864 tst iperf3_ul.py:13: Number of physical ue: 1 13:57:32.897546 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 13:57:32.938684 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 13:57:33.139833 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 13:57:33.155182 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 13:57:33.187570 tst iperf3_ul.py: using MSISDN 7778 13:57:33.299229 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7778', subscriber_id=0} 13:57:33.404567 run srsepc_10.42.42.118: Starting srsepc 13:57:34.023689 run rm-remote-dir(pid=16292): Launched 13:57:35.201992 run rm-remote-dir(pid=16292): Terminated: ok {rc=0} 13:57:35.532779 run mk-remote-dir(pid=16293): Launched 13:57:36.710793 run mk-remote-dir(pid=16293): Terminated: ok {rc=0} 13:57:36.994910 run scp-inst-to-remote(pid=16297): Launched 13:57:39.176784 run scp-inst-to-remote(pid=16297): Terminated: ok {rc=0} 13:57:39.529121 run rm-remote-dir(pid=16299): Launched 13:57:40.716777 run rm-remote-dir(pid=16299): Terminated: ok {rc=0} 13:57:41.069403 run mk-remote-dir(pid=16300): Launched 13:57:42.257258 run mk-remote-dir(pid=16300): Terminated: ok {rc=0} 13:57:42.558675 run scp-cfg-to-remote(pid=16301): Launched 13:57:43.743222 run scp-cfg-to-remote(pid=16301): Terminated: ok {rc=0} 13:57:44.041654 run scp-db-to-remote(pid=16303): Launched 13:57:45.225456 run scp-db-to-remote(pid=16303): Terminated: ok {rc=0} 13:57:45.363781 run srsepc_10.42.42.118: Setting RPATH for srsepc 13:57:45.689164 run patchelf(pid=16305): Launched 13:57:46.872753 run patchelf(pid=16305): Terminated: ok {rc=0} 13:57:47.014894 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 13:57:47.351812 run setcap-netadm(pid=16306): Launched 13:57:48.532304 run setcap-netadm(pid=16306): Terminated: ok {rc=0} 13:57:48.873256 run srsepc(pid=16307): Launched 13:57:48.994065 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 13:57:50.162958 run rm-remote-dir(pid=16308): Launched 13:57:50.348421 run srsepc(pid=16307): ERR: Terminated: ERROR {rc=127} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16307)] 13:57:50.490891 run srsepc(pid=16307): stdout: | (launched: 2022-12-10_13:57:48.814887) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:57:50.634103 run srsepc(pid=16307): stderr: | (launched: 2022-12-10_13:57:48.863181) | Connection to 10.42.42.116 closed. 13:57:50.777339 run srsepc(pid=16307): stdout: | (launched: 2022-12-10_13:57:48.814887) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:57:50.914497 run srsepc(pid=16307): stderr: | (launched: 2022-12-10_13:57:48.863181) | Connection to 10.42.42.116 closed. 13:57:51.076918 run rm-remote-dir(pid=16308): Terminating (SIGINT) 13:57:51.263576 run rm-remote-dir(pid=16308): Terminated: ok {rc=0} 13:57:51.399204 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=16307): Process ended prematurely: srsepc(pid=16307) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16307)] [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 13:57:51.409824 tst iperf3_ul.py:42: Test FAILED (18.7 sec) 13:57:51.490176 run scp-back-log(pid=16309): Launched 13:57:52.569661 run scp-back-log(pid=16309): ERR: Terminated: ERROR {rc=1} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16309)] 13:57:52.633412 run scp-back-log(pid=16309): stdout: | (launched: 2022-12-10_13:57:51.458598) 13:57:52.698348 run scp-back-log(pid=16309): stderr: | (launched: 2022-12-10_13:57:51.479532) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 13:57:52.771444 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16309): launch_sync(): local process exited with status 1 [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16309)]') ---------------------------------------------- trial-2375 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 13:57:52.819280 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 13:57:52.836029 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 13:57:52.859595 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 13:57:52.909998 tst ping.py: using MSISDN 7779 13:57:53.023276 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7779', subscriber_id=0} 13:57:53.130071 run srsepc_10.42.42.118: Starting srsepc 13:57:53.755177 run rm-remote-dir(pid=16311): Launched 13:57:54.932121 run rm-remote-dir(pid=16311): Terminated: ok {rc=0} 13:57:55.263387 run mk-remote-dir(pid=16312): Launched 13:57:56.440075 run mk-remote-dir(pid=16312): Terminated: ok {rc=0} 13:57:56.721902 run scp-inst-to-remote(pid=16313): Launched 13:57:58.899224 run scp-inst-to-remote(pid=16313): Terminated: ok {rc=0} 13:57:59.227829 run rm-remote-dir(pid=16315): Launched 13:58:00.405084 run rm-remote-dir(pid=16315): Terminated: ok {rc=0} 13:58:00.735591 run mk-remote-dir(pid=16316): Launched 13:58:01.939423 run mk-remote-dir(pid=16316): Terminated: ok {rc=0} 13:58:02.267678 run scp-cfg-to-remote(pid=16317): Launched 13:58:03.457584 run scp-cfg-to-remote(pid=16317): Terminated: ok {rc=0} 13:58:03.757156 run scp-db-to-remote(pid=16319): Launched 13:58:04.942670 run scp-db-to-remote(pid=16319): Terminated: ok {rc=0} 13:58:05.080772 run srsepc_10.42.42.118: Setting RPATH for srsepc 13:58:05.405687 run patchelf(pid=16321): Launched 13:58:06.591399 run patchelf(pid=16321): Terminated: ok {rc=0} 13:58:06.729661 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 13:58:07.054196 run setcap-netadm(pid=16322): Launched 13:58:08.235191 run setcap-netadm(pid=16322): Terminated: ok {rc=0} 13:58:08.553203 run srsepc(pid=16323): Launched 13:58:08.666986 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 13:58:09.763988 run rm-remote-dir(pid=16324): Launched 13:58:09.939753 run srsepc(pid=16323): ERR: Terminated: ERROR {rc=127} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16323)] 13:58:10.075221 run srsepc(pid=16323): stdout: | (launched: 2022-12-10_13:58:08.497927) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:58:10.208750 run srsepc(pid=16323): stderr: | (launched: 2022-12-10_13:58:08.542873) | Connection to 10.42.42.116 closed. 13:58:10.342251 run srsepc(pid=16323): stdout: | (launched: 2022-12-10_13:58:08.497927) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:58:10.470026 run srsepc(pid=16323): stderr: | (launched: 2022-12-10_13:58:08.542873) | Connection to 10.42.42.116 closed. 13:58:10.621184 run rm-remote-dir(pid=16324): Terminating (SIGINT) 13:58:10.795806 run rm-remote-dir(pid=16324): Terminated: ok {rc=0} 13:58:10.922680 tst ping.py:16: ERR: Error: srsepc(pid=16323): Process ended prematurely: srsepc(pid=16323) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16323)] [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 13:58:10.932425 tst ping.py:16: Test FAILED (18.1 sec) 13:58:11.007308 run scp-back-log(pid=16325): Launched 13:58:12.082452 run scp-back-log(pid=16325): ERR: Terminated: ERROR {rc=1} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16325)] 13:58:12.141648 run scp-back-log(pid=16325): stdout: | (launched: 2022-12-10_13:58:10.977802) 13:58:12.202293 run scp-back-log(pid=16325): stderr: | (launched: 2022-12-10_13:58:10.997112) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 13:58:12.270504 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16325): launch_sync(): local process exited with status 1 [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16325)]') ---------------------------------------------- trial-2375 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 13:58:12.314881 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 13:58:12.331133 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 13:58:12.353610 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 13:58:12.406500 tst rrc_idle_mo_ping.py: using MSISDN 7780 13:58:12.520132 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7780', subscriber_id=0} 13:58:12.625738 run srsepc_10.42.42.118: Starting srsepc 13:58:13.244779 run rm-remote-dir(pid=16327): Launched 13:58:14.422098 run rm-remote-dir(pid=16327): Terminated: ok {rc=0} 13:58:14.751482 run mk-remote-dir(pid=16328): Launched 13:58:15.954380 run mk-remote-dir(pid=16328): Terminated: ok {rc=0} 13:58:16.287021 run scp-inst-to-remote(pid=16329): Launched 13:58:18.501464 run scp-inst-to-remote(pid=16329): Terminated: ok {rc=0} 13:58:18.828816 run rm-remote-dir(pid=16331): Launched 13:58:20.006260 run rm-remote-dir(pid=16331): Terminated: ok {rc=0} 13:58:20.335285 run mk-remote-dir(pid=16332): Launched 13:58:21.512051 run mk-remote-dir(pid=16332): Terminated: ok {rc=0} 13:58:21.793067 run scp-cfg-to-remote(pid=16333): Launched 13:58:22.967009 run scp-cfg-to-remote(pid=16333): Terminated: ok {rc=0} 13:58:23.245844 run scp-db-to-remote(pid=16335): Launched 13:58:24.420845 run scp-db-to-remote(pid=16335): Terminated: ok {rc=0} 13:58:24.549717 run srsepc_10.42.42.118: Setting RPATH for srsepc 13:58:24.852198 run patchelf(pid=16337): Launched 13:58:26.026539 run patchelf(pid=16337): Terminated: ok {rc=0} 13:58:26.156420 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 13:58:26.458970 run setcap-netadm(pid=16338): Launched 13:58:27.632903 run setcap-netadm(pid=16338): Terminated: ok {rc=0} 13:58:27.950337 run srsepc(pid=16339): Launched 13:58:28.063663 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 13:58:29.166696 run rm-remote-dir(pid=16340): Launched 13:58:29.342336 run srsepc(pid=16339): ERR: Terminated: ERROR {rc=127} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16339)] 13:58:29.475807 run srsepc(pid=16339): stdout: | (launched: 2022-12-10_13:58:27.895580) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:58:29.610006 run srsepc(pid=16339): stderr: | (launched: 2022-12-10_13:58:27.940368) | Connection to 10.42.42.116 closed. 13:58:29.743544 run srsepc(pid=16339): stdout: | (launched: 2022-12-10_13:58:27.895580) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:58:29.871552 run srsepc(pid=16339): stderr: | (launched: 2022-12-10_13:58:27.940368) | Connection to 10.42.42.116 closed. 13:58:30.023089 run rm-remote-dir(pid=16340): Terminating (SIGINT) 13:58:30.199952 run rm-remote-dir(pid=16340): Terminated: ok {rc=0} 13:58:30.327739 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=16339): Process ended prematurely: srsepc(pid=16339) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16339)] [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 13:58:30.337579 tst rrc_idle_mo_ping.py:16: Test FAILED (18.0 sec) 13:58:30.412547 run scp-back-log(pid=16341): Launched 13:58:31.499433 run scp-back-log(pid=16341): ERR: Terminated: ERROR {rc=1} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16341)] 13:58:31.573755 run scp-back-log(pid=16341): stdout: | (launched: 2022-12-10_13:58:30.383087) 13:58:31.649236 run scp-back-log(pid=16341): stderr: | (launched: 2022-12-10_13:58:30.402635) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 13:58:31.732351 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16341): launch_sync(): local process exited with status 1 [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16341)]') ---------------------------------------------- trial-2375 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 13:58:31.788815 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 13:58:31.813920 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 13:58:31.845169 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 13:58:31.892725 tst rrc_idle_mt_ping.py: using MSISDN 7781 13:58:32.053751 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7781', subscriber_id=0} 13:58:32.204042 run srsepc_10.42.42.118: Starting srsepc 13:58:32.829367 run rm-remote-dir(pid=16343): Launched 13:58:34.009836 run rm-remote-dir(pid=16343): Terminated: ok {rc=0} 13:58:34.363795 run mk-remote-dir(pid=16344): Launched 13:58:35.551233 run mk-remote-dir(pid=16344): Terminated: ok {rc=0} 13:58:35.854305 run scp-inst-to-remote(pid=16345): Launched 13:58:38.040739 run scp-inst-to-remote(pid=16345): Terminated: ok {rc=0} 13:58:38.392397 run rm-remote-dir(pid=16347): Launched 13:58:39.579305 run rm-remote-dir(pid=16347): Terminated: ok {rc=0} 13:58:39.932125 run mk-remote-dir(pid=16348): Launched 13:58:41.119256 run mk-remote-dir(pid=16348): Terminated: ok {rc=0} 13:58:41.420519 run scp-cfg-to-remote(pid=16349): Launched 13:58:42.605437 run scp-cfg-to-remote(pid=16349): Terminated: ok {rc=0} 13:58:42.904083 run scp-db-to-remote(pid=16351): Launched 13:58:44.089645 run scp-db-to-remote(pid=16351): Terminated: ok {rc=0} 13:58:44.228842 run srsepc_10.42.42.118: Setting RPATH for srsepc 13:58:44.554800 run patchelf(pid=16354): Launched 13:58:45.739708 run patchelf(pid=16354): Terminated: ok {rc=0} 13:58:45.880513 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 13:58:46.209803 run setcap-netadm(pid=16355): Launched 13:58:47.458602 run setcap-netadm(pid=16355): Terminated: ok {rc=0} 13:58:47.778820 run srsepc(pid=16356): Launched 13:58:47.893497 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 13:58:48.998131 run rm-remote-dir(pid=16357): Launched 13:58:49.174412 run srsepc(pid=16356): ERR: Terminated: ERROR {rc=127} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16356)] 13:58:49.309202 run srsepc(pid=16356): stdout: | (launched: 2022-12-10_13:58:47.723698) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:58:49.443271 run srsepc(pid=16356): stderr: | (launched: 2022-12-10_13:58:47.768774) | Connection to 10.42.42.116 closed. 13:58:49.577302 run srsepc(pid=16356): stdout: | (launched: 2022-12-10_13:58:47.723698) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 13:58:49.705298 run srsepc(pid=16356): stderr: | (launched: 2022-12-10_13:58:47.768774) | Connection to 10.42.42.116 closed. 13:58:49.856483 run rm-remote-dir(pid=16357): Terminating (SIGINT) 13:58:50.032727 run rm-remote-dir(pid=16357): Terminated: ok {rc=0} 13:58:50.160583 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=16356): Process ended prematurely: srsepc(pid=16356) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16356)] [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 13:58:50.170595 tst rrc_idle_mt_ping.py:16: Test FAILED (18.4 sec) 13:58:50.246524 run scp-back-log(pid=16358): Launched 13:58:51.322833 run scp-back-log(pid=16358): ERR: Terminated: ERROR {rc=1} [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16358)] 13:58:51.382758 run scp-back-log(pid=16358): stdout: | (launched: 2022-12-10_13:58:50.216346) 13:58:51.444371 run scp-back-log(pid=16358): stderr: | (launched: 2022-12-10_13:58:50.236261) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 13:58:51.513211 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16358): launch_sync(): local process exited with status 1 [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16358)]') --------------------------------------------------------------------- trial-2375 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 13:58:51.641391 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:58:51.646253 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 13:58:51.686370 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 13:58:51.712281 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 13:58:51.761864 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 13:58:51.802723 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 13:58:51.828568 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 13:58:52.381971 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 13:58:52.388459 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 13:58:52.400202 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 13:58:52.441380 tst handover.py: using LAC 28868 13:58:52.571749 tst handover.py: using RAC 53 13:58:52.698083 tst handover.py: using CellId 28868 13:58:52.826969 tst handover.py: using BVCI 28869 13:58:52.945303 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 13:58:52.979449 tst handover.py: using LAC 28869 13:58:53.102342 tst handover.py: using RAC 54 13:58:53.225945 tst handover.py: using CellId 28869 13:58:53.352108 tst handover.py: using BVCI 28870 13:58:53.469349 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 13:58:53.480321 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 13:58:53.491210 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 13:58:53.502366 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 13:58:53.514067 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 13:58:53.525534 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 13:58:53.640074 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 13:58:53.754951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:54.216928 run create_hlr_db(pid=16365): Launched 13:58:55.385261 run create_hlr_db(pid=16365): Terminated: ok {rc=0} 13:58:55.700433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16367): Launched 13:58:55.997734 run osmo-hlr_10.42.42.2(pid=16368): Launched 13:58:56.110481 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:56.639802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16370): Launched 13:58:56.937155 run osmo-stp_10.42.42.5(pid=16371): Launched 13:58:57.051137 run osmo-msc_10.42.42.6: Starting osmo-msc 13:58:57.589468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16373): Launched 13:58:57.887423 run osmo-msc_10.42.42.6(pid=16374): Launched 13:58:58.054520 run osmo-stp_10.42.42.5(pid=16371): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16371)] 13:58:58.181906 run osmo-stp_10.42.42.5(pid=16371): stdout: | (launched: 2022-12-10_13:58:56.882900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:58.308509 run osmo-stp_10.42.42.5(pid=16371): stderr: | [0;m[38;5;43m20221210135857053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135857053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135857053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135857054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135857054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135857054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135857054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:58.432101 run osmo-stp_10.42.42.5(pid=16371): stdout: | (launched: 2022-12-10_13:58:56.882900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:58.549814 run osmo-stp_10.42.42.5(pid=16371): stderr: | [0;m[38;5;43m20221210135857053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135857053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135857053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135857054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135857054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135857054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135857054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:58.690369 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16371): Process ended prematurely: osmo-stp_10.42.42.5(pid=16371) [trial-2375↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16371)] [trial-2375↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 13:58:58.698447 tst handover.py:18: Test FAILED (6.3 sec) 13:58:58.723861 run osmo-hlr_10.42.42.2(pid=16368): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16368)] 13:58:58.770779 run osmo-hlr_10.42.42.2(pid=16368): stdout: | (launched: 2022-12-10_13:58:55.942962) 13:58:58.819163 run osmo-hlr_10.42.42.2(pid=16368): stderr: | [0;m[1;31m20221210135856117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135856117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135856117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135856117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135856117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135856118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135856130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135856138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135856139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135856139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:58.887025 run osmo-msc_10.42.42.6(pid=16374): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16374)] 13:58:58.934067 run osmo-msc_10.42.42.6(pid=16374): stdout: | (launched: 2022-12-10_13:58:57.832860) 13:58:58.982591 run osmo-msc_10.42.42.6(pid=16374): stderr: | [0;m[38;5;43m20221210135858100 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135858101 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fde38ffac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135858101 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135858101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135858101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135858101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135858103 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135858103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135858103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135858103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:58:59.031591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16367): Terminating (SIGTERM) 13:58:59.070485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16370): Terminating (SIGTERM) 13:58:59.109744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16373): Terminating (SIGTERM) 13:58:59.149123 --- ParallelTerminationStrategy: PID 16367 died... 13:58:59.167811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16367): Terminated: ok {rc=0} 13:58:59.211832 --- ParallelTerminationStrategy: PID 16370 died... 13:58:59.230159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16370): Terminated: ok {rc=0} 13:58:59.273372 --- ParallelTerminationStrategy: PID 16373 died... 13:58:59.291623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16373): Terminated: ok {rc=0} 13:58:59.375970 bus /sierra_3: Setting Powered False 13:59:00.475434 bus /sierra_3: Setting Powered False 13:59:01.589646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 13:59:02.832699 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:59:02.837482 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 13:59:02.875995 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 13:59:02.901880 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 13:59:02.951632 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 13:59:02.990228 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 13:59:03.015899 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 13:59:03.568820 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 13:59:03.573952 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 13:59:03.584437 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 13:59:03.620222 tst handover.py: using LAC 28870 13:59:03.737331 tst handover.py: using RAC 55 13:59:03.853896 tst handover.py: using CellId 28870 13:59:03.976145 tst handover.py: using BVCI 28871 13:59:04.094773 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 13:59:04.127816 tst handover.py: using LAC 28871 13:59:04.251826 tst handover.py: using RAC 56 13:59:04.376393 tst handover.py: using CellId 28871 13:59:04.500010 tst handover.py: using BVCI 28872 13:59:04.617147 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 13:59:04.628334 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 13:59:04.639482 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 13:59:04.651286 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 13:59:04.663425 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 13:59:04.675092 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 13:59:04.791087 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 13:59:04.911648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:05.376674 run create_hlr_db(pid=16380): Launched 13:59:05.506531 bus /sierra_2: Setting Powered False 13:59:06.568806 run create_hlr_db(pid=16380): Terminated: ok {rc=0} 13:59:06.969977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16382): Launched 13:59:07.268789 run osmo-hlr_10.42.42.2(pid=16383): Launched 13:59:07.382903 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:07.885221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16385): Launched 13:59:08.184111 run osmo-stp_10.42.42.5(pid=16386): Launched 13:59:08.297124 run osmo-msc_10.42.42.6: Starting osmo-msc 13:59:08.812419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16388): Launched 13:59:09.111653 run osmo-msc_10.42.42.6(pid=16389): Launched 13:59:09.278838 run osmo-stp_10.42.42.5(pid=16386): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16386)] 13:59:09.406392 run osmo-stp_10.42.42.5(pid=16386): stdout: | (launched: 2022-12-10_13:59:08.129707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:09.532804 run osmo-stp_10.42.42.5(pid=16386): stderr: | [0;m[38;5;43m20221210135908299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135908299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135908300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135908300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135908301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135908301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135908301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:09.657512 run osmo-stp_10.42.42.5(pid=16386): stdout: | (launched: 2022-12-10_13:59:08.129707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:09.776341 run osmo-stp_10.42.42.5(pid=16386): stderr: | [0;m[38;5;43m20221210135908299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135908299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135908300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135908300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135908301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135908301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135908301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:09.918452 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16386): Process ended prematurely: osmo-stp_10.42.42.5(pid=16386) [trial-2375↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16386)] [trial-2375↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 13:59:09.926690 tst handover.py:18: Test FAILED (6.3 sec) 13:59:09.952128 run osmo-hlr_10.42.42.2(pid=16383): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16383)] 13:59:09.998689 run osmo-hlr_10.42.42.2(pid=16383): stdout: | (launched: 2022-12-10_13:59:07.214442) 13:59:10.047017 run osmo-hlr_10.42.42.2(pid=16383): stderr: | [0;m[1;31m20221210135907388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135907388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135907388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135907388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135907388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135907388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135907402 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135907411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135907411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135907411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:10.114442 run osmo-msc_10.42.42.6(pid=16389): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16389)] 13:59:10.161238 run osmo-msc_10.42.42.6(pid=16389): stdout: | (launched: 2022-12-10_13:59:09.057115) 13:59:10.209773 run osmo-msc_10.42.42.6(pid=16389): stderr: | [0;m[38;5;43m20221210135909326 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135909326 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fad223eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135909326 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135909327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135909327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135909327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135909329 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135909329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135909329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135909329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:59:10.258169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16382): Terminating (SIGTERM) 13:59:10.297045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16385): Terminating (SIGTERM) 13:59:10.335872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16388): Terminating (SIGTERM) 13:59:10.375061 --- ParallelTerminationStrategy: PID 16382 died... 13:59:10.393957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16382): Terminated: ok {rc=0} 13:59:10.437148 --- ParallelTerminationStrategy: PID 16385 died... 13:59:10.455250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16385): Terminated: ok {rc=0} 13:59:10.498343 --- ParallelTerminationStrategy: PID 16388 died... 13:59:10.516797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16388): Terminated: ok {rc=0} 13:59:10.601624 bus /sierra_3: Setting Powered False 13:59:11.699939 bus /sierra_3: Setting Powered False 13:59:12.813040 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 13:59:14.063571 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:59:14.070209 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 13:59:14.124723 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 13:59:14.151764 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 13:59:14.204693 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 13:59:14.259205 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 13:59:14.285753 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 13:59:14.836381 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 13:59:14.841806 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 13:59:14.852816 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 13:59:14.891552 tst handover.py: using LAC 28872 13:59:15.016730 tst handover.py: using RAC 57 13:59:15.139596 tst handover.py: using CellId 28872 13:59:15.262741 tst handover.py: using BVCI 28873 13:59:15.378344 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 13:59:15.425395 tst handover.py: using LAC 28873 13:59:15.551362 tst handover.py: using RAC 58 13:59:15.676351 tst handover.py: using CellId 28873 13:59:15.799112 tst handover.py: using BVCI 28874 13:59:15.928402 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 13:59:15.940244 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 13:59:15.952578 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 13:59:15.964319 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 13:59:15.976723 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 13:59:15.989826 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 13:59:16.115001 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 13:59:16.262157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:16.776588 run create_hlr_db(pid=16394): Launched 13:59:16.924915 bus /sierra_2: Setting Powered False 13:59:17.984800 run create_hlr_db(pid=16394): Terminated: ok {rc=0} 13:59:18.375598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16396): Launched 13:59:18.674747 run osmo-hlr_10.42.42.2(pid=16397): Launched 13:59:18.788487 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:19.287418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16399): Launched 13:59:19.584929 run osmo-stp_10.42.42.5(pid=16400): Launched 13:59:19.698902 run osmo-msc_10.42.42.6: Starting osmo-msc 13:59:20.212903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16402): Launched 13:59:20.510793 run osmo-msc_10.42.42.6(pid=16403): Launched 13:59:20.677373 run osmo-stp_10.42.42.5(pid=16400): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16400)] 13:59:20.804123 run osmo-stp_10.42.42.5(pid=16400): stdout: | (launched: 2022-12-10_13:59:19.530382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:20.930029 run osmo-stp_10.42.42.5(pid=16400): stderr: | [0;m[38;5;43m20221210135919700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135919701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135919701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135919701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135919702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135919702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135919702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:21.054149 run osmo-stp_10.42.42.5(pid=16400): stdout: | (launched: 2022-12-10_13:59:19.530382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:21.172352 run osmo-stp_10.42.42.5(pid=16400): stderr: | [0;m[38;5;43m20221210135919700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135919701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135919701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135919701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135919702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135919702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135919702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:21.314004 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16400): Process ended prematurely: osmo-stp_10.42.42.5(pid=16400) [trial-2375↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16400)] [trial-2375↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 13:59:21.322182 tst handover.py:18: Test FAILED (6.5 sec) 13:59:21.347567 run osmo-hlr_10.42.42.2(pid=16397): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16397)] 13:59:21.394211 run osmo-hlr_10.42.42.2(pid=16397): stdout: | (launched: 2022-12-10_13:59:18.620125) 13:59:21.442278 run osmo-hlr_10.42.42.2(pid=16397): stderr: | [0;m[1;31m20221210135918796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135918796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135918796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135918796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135918796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135918796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135918809 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135918818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135918818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135918818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:21.509732 run osmo-msc_10.42.42.6(pid=16403): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16403)] 13:59:21.556396 run osmo-msc_10.42.42.6(pid=16403): stdout: | (launched: 2022-12-10_13:59:20.455607) 13:59:21.604578 run osmo-msc_10.42.42.6(pid=16403): stderr: | [0;m[38;5;43m20221210135920728 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135920728 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9647151c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135920728 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135920728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135920729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135920729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135920731 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135920731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135920731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135920731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:59:21.653076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16396): Terminating (SIGTERM) 13:59:21.691698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16399): Terminating (SIGTERM) 13:59:21.730332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16402): Terminating (SIGTERM) 13:59:21.769193 --- ParallelTerminationStrategy: PID 16396 died... 13:59:21.787742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16396): Terminated: ok {rc=0} 13:59:21.831024 --- ParallelTerminationStrategy: PID 16399 died... 13:59:21.849292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16399): Terminated: ok {rc=0} 13:59:21.891920 --- ParallelTerminationStrategy: PID 16402 died... 13:59:21.910150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16402): Terminated: ok {rc=0} 13:59:21.991077 bus /sierra_3: Setting Powered False 13:59:23.087930 bus /sierra_3: Setting Powered False 13:59:24.202577 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 13:59:25.460736 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:59:25.466195 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 13:59:25.516505 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:59:25.543857 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 13:59:25.597131 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 13:59:25.648297 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:59:25.675433 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 13:59:26.226149 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 13:59:26.231419 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:59:26.242709 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 13:59:26.280933 tst handover.py: using LAC 28874 13:59:26.405792 tst handover.py: using RAC 59 13:59:26.532095 tst handover.py: using CellId 28874 13:59:26.656683 tst handover.py: using BVCI 28875 13:59:26.772372 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 13:59:26.821707 tst handover.py: using LAC 28875 13:59:26.945602 tst handover.py: using RAC 60 13:59:27.071131 tst handover.py: using CellId 28875 13:59:27.195855 tst handover.py: using BVCI 28876 13:59:27.311283 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:59:27.322668 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:59:27.333884 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:59:27.345502 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:59:27.356806 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:59:27.368211 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:59:27.486050 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:59:27.603750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:28.067683 run create_hlr_db(pid=16408): Launched 13:59:28.188737 bus /sierra_2: Setting Powered False 13:59:29.252240 run create_hlr_db(pid=16408): Terminated: ok {rc=0} 13:59:29.667699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16410): Launched 13:59:29.985488 run osmo-hlr_10.42.42.2(pid=16411): Launched 13:59:30.108855 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:30.631662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16413): Launched 13:59:30.965712 run osmo-stp_10.42.42.5(pid=16414): Launched 13:59:31.125869 run osmo-msc_10.42.42.6: Starting osmo-msc 13:59:31.785683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16416): Launched 13:59:32.118463 run osmo-msc_10.42.42.6(pid=16417): Launched 13:59:32.356551 run osmo-stp_10.42.42.5(pid=16414): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16414)] 13:59:32.497714 run osmo-stp_10.42.42.5(pid=16414): stdout: | (launched: 2022-12-10_13:59:30.892821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:32.629194 run osmo-stp_10.42.42.5(pid=16414): stderr: | [0;m[38;5;43m20221210135931252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135931252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135931252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135931252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135931253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135931258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135931258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:32.754865 run osmo-stp_10.42.42.5(pid=16414): stdout: | (launched: 2022-12-10_13:59:30.892821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:32.873815 run osmo-stp_10.42.42.5(pid=16414): stderr: | [0;m[38;5;43m20221210135931252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135931252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135931252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135931252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135931253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135931258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135931258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:33.016604 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16414): Process ended prematurely: osmo-stp_10.42.42.5(pid=16414) [trial-2375↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16414)] [trial-2375↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 13:59:33.024907 tst handover.py:18: Test FAILED (6.8 sec) 13:59:33.050665 run osmo-hlr_10.42.42.2(pid=16411): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16411)] 13:59:33.097904 run osmo-hlr_10.42.42.2(pid=16411): stdout: | (launched: 2022-12-10_13:59:29.928024) 13:59:33.146449 run osmo-hlr_10.42.42.2(pid=16411): stderr: | [0;m[1;31m20221210135930125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135930126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135930126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135930126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135930126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135930126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135930138 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135930146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135930146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135930146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:33.214504 run osmo-msc_10.42.42.6(pid=16417): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16417)] 13:59:33.261545 run osmo-msc_10.42.42.6(pid=16417): stdout: | (launched: 2022-12-10_13:59:32.050427) 13:59:33.310075 run osmo-msc_10.42.42.6(pid=16417): stderr: | [0;m[38;5;43m20221210135932497 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135932497 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8218e39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135932498 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135932498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135932498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135932498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135932500 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135932500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135932500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135932500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:59:33.359106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16410): Terminating (SIGTERM) 13:59:33.398253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16413): Terminating (SIGTERM) 13:59:33.437517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16416): Terminating (SIGTERM) 13:59:33.476910 --- ParallelTerminationStrategy: PID 16410 died... 13:59:33.495592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16410): Terminated: ok {rc=0} 13:59:33.539141 --- ParallelTerminationStrategy: PID 16413 died... 13:59:33.557931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16413): Terminated: ok {rc=0} 13:59:33.601389 --- ParallelTerminationStrategy: PID 16416 died... 13:59:33.619602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16416): Terminated: ok {rc=0} 13:59:33.705531 bus /sierra_3: Setting Powered False 13:59:34.804289 bus /sierra_3: Setting Powered False 13:59:35.918339 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 13:59:37.172346 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:59:37.177298 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 13:59:37.229602 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:59:37.255463 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 13:59:37.306497 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 13:59:37.360046 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:59:37.385917 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 13:59:37.936063 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 13:59:37.941027 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:59:37.952029 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 13:59:37.989048 tst handover.py: using LAC 28876 13:59:38.109423 tst handover.py: using RAC 61 13:59:38.226676 tst handover.py: using CellId 28876 13:59:38.341745 tst handover.py: using BVCI 28877 13:59:38.449231 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 13:59:38.496363 tst handover.py: using LAC 28877 13:59:38.611956 tst handover.py: using RAC 62 13:59:38.727447 tst handover.py: using CellId 28877 13:59:38.843066 tst handover.py: using BVCI 28878 13:59:38.950636 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:59:38.961510 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:59:38.972047 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:59:38.982713 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:59:38.993379 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:59:39.003827 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:59:39.122607 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:59:39.238180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:39.675768 run create_hlr_db(pid=16422): Launched 13:59:39.797967 bus /sierra_2: Setting Powered False 13:59:40.857975 run create_hlr_db(pid=16422): Terminated: ok {rc=0} 13:59:41.265593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16424): Launched 13:59:41.584936 run osmo-hlr_10.42.42.2(pid=16425): Launched 13:59:41.709647 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:42.236387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16427): Launched 13:59:42.554898 run osmo-stp_10.42.42.5(pid=16428): Launched 13:59:42.677342 run osmo-msc_10.42.42.6: Starting osmo-msc 13:59:43.225070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16430): Launched 13:59:43.542753 run osmo-msc_10.42.42.6(pid=16431): Launched 13:59:43.722667 run osmo-stp_10.42.42.5(pid=16428): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16428)] 13:59:43.858111 run osmo-stp_10.42.42.5(pid=16428): stdout: | (launched: 2022-12-10_13:59:42.497063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:43.993997 run osmo-stp_10.42.42.5(pid=16428): stderr: | [0;m[38;5;43m20221210135942690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135942690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135942691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135942691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135942692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135942692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135942692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:44.128392 run osmo-stp_10.42.42.5(pid=16428): stdout: | (launched: 2022-12-10_13:59:42.497063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:44.255231 run osmo-stp_10.42.42.5(pid=16428): stderr: | [0;m[38;5;43m20221210135942690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135942690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135942691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135942691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135942692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135942692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135942692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:44.406883 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16428): Process ended prematurely: osmo-stp_10.42.42.5(pid=16428) [trial-2375↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16428)] [trial-2375↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 13:59:44.415841 tst handover.py:18: Test FAILED (6.5 sec) 13:59:44.443650 run osmo-hlr_10.42.42.2(pid=16425): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16425)] 13:59:44.493617 run osmo-hlr_10.42.42.2(pid=16425): stdout: | (launched: 2022-12-10_13:59:41.526716) 13:59:44.545502 run osmo-hlr_10.42.42.2(pid=16425): stderr: | [0;m[1;31m20221210135941724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135941724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135941724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135941725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135941725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135941725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135941740 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135941748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135941749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135941749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:44.617023 run osmo-msc_10.42.42.6(pid=16431): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16431)] 13:59:44.666632 run osmo-msc_10.42.42.6(pid=16431): stdout: | (launched: 2022-12-10_13:59:43.485242) 13:59:44.717746 run osmo-msc_10.42.42.6(pid=16431): stderr: | [0;m[38;5;43m20221210135943804 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135943804 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f645dc25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135943804 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135943804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135943804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135943804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135943806 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135943806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135943806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135943807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:59:44.769243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16424): Terminating (SIGTERM) 13:59:44.810646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16427): Terminating (SIGTERM) 13:59:44.852238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16430): Terminating (SIGTERM) 13:59:44.893764 --- ParallelTerminationStrategy: PID 16424 died... 13:59:44.913420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16424): Terminated: ok {rc=0} 13:59:44.959121 --- ParallelTerminationStrategy: PID 16427 died... 13:59:44.978663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16427): Terminated: ok {rc=0} 13:59:45.024412 --- ParallelTerminationStrategy: PID 16430 died... 13:59:45.043712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16430): Terminated: ok {rc=0} 13:59:45.130720 bus /sierra_3: Setting Powered False 13:59:46.233900 bus /sierra_3: Setting Powered False 13:59:47.365830 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 13:59:48.621909 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:59:48.626751 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 13:59:48.666975 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 13:59:48.693437 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 13:59:48.743837 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 13:59:48.783936 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 13:59:48.809992 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 13:59:49.360444 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 13:59:49.365479 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 13:59:49.375940 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 13:59:49.412886 tst handover.py: using LAC 28878 13:59:49.531720 tst handover.py: using RAC 63 13:59:49.650847 tst handover.py: using CellId 28878 13:59:49.769296 tst handover.py: using BVCI 28879 13:59:49.876720 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 13:59:49.911567 tst handover.py: using LAC 28879 13:59:50.029015 tst handover.py: using RAC 64 13:59:50.145656 tst handover.py: using CellId 28879 13:59:50.262512 tst handover.py: using BVCI 28880 13:59:50.370659 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 13:59:50.381285 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 13:59:50.391678 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 13:59:50.402139 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 13:59:50.412668 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 13:59:50.423115 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 13:59:50.537438 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 13:59:50.654224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:51.122628 run create_hlr_db(pid=16436): Launched 13:59:51.244491 bus /sierra_2: Setting Powered False 13:59:52.307982 run create_hlr_db(pid=16436): Terminated: ok {rc=0} 13:59:52.723063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16438): Launched 13:59:53.040712 run osmo-hlr_10.42.42.2(pid=16439): Launched 13:59:53.162955 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:53.686552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16441): Launched 13:59:54.003396 run osmo-stp_10.42.42.5(pid=16442): Launched 13:59:54.124897 run osmo-msc_10.42.42.6: Starting osmo-msc 13:59:54.673447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16444): Launched 13:59:54.993573 run osmo-msc_10.42.42.6(pid=16445): Launched 13:59:55.173102 run osmo-stp_10.42.42.5(pid=16442): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16442)] 13:59:55.310106 run osmo-stp_10.42.42.5(pid=16442): stdout: | (launched: 2022-12-10_13:59:53.946062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:55.447580 run osmo-stp_10.42.42.5(pid=16442): stderr: | [0;m[38;5;43m20221210135954137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135954137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135954138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135954138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135954138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135954138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135954139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:55.583100 run osmo-stp_10.42.42.5(pid=16442): stdout: | (launched: 2022-12-10_13:59:53.946062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:55.710953 run osmo-stp_10.42.42.5(pid=16442): stderr: | [0;m[38;5;43m20221210135954137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210135954137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210135954138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210135954138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210135954138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210135954138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210135954139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:55.863409 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16442): Process ended prematurely: osmo-stp_10.42.42.5(pid=16442) [trial-2375↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16442)] [trial-2375↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 13:59:55.872163 tst handover.py:18: Test FAILED (6.5 sec) 13:59:55.899603 run osmo-hlr_10.42.42.2(pid=16439): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16439)] 13:59:55.949430 run osmo-hlr_10.42.42.2(pid=16439): stdout: | (launched: 2022-12-10_13:59:52.983150) 13:59:56.001080 run osmo-hlr_10.42.42.2(pid=16439): stderr: | [0;m[1;31m20221210135953178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210135953178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210135953178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210135953178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210135953178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210135953179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210135953190 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210135953200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210135953200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210135953200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:56.072711 run osmo-msc_10.42.42.6(pid=16445): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16445)] 13:59:56.122209 run osmo-msc_10.42.42.6(pid=16445): stdout: | (launched: 2022-12-10_13:59:54.934898) 13:59:56.173599 run osmo-msc_10.42.42.6(pid=16445): stderr: | [0;m[38;5;43m20221210135955254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210135955254 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f494229ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210135955254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210135955254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210135955255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210135955255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210135955256 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210135955257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210135955257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210135955257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:59:56.225566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16438): Terminating (SIGTERM) 13:59:56.267260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16441): Terminating (SIGTERM) 13:59:56.308823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16444): Terminating (SIGTERM) 13:59:56.351400 --- ParallelTerminationStrategy: PID 16438 died... 13:59:56.371282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16438): Terminated: ok {rc=0} 13:59:56.417666 --- ParallelTerminationStrategy: PID 16441 died... 13:59:56.437211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16441): Terminated: ok {rc=0} 13:59:56.483528 --- ParallelTerminationStrategy: PID 16444 died... 13:59:56.503036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16444): Terminated: ok {rc=0} 13:59:56.591211 bus /sierra_3: Setting Powered False 13:59:57.689855 bus /sierra_3: Setting Powered False 13:59:58.805842 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 14:00:00.052064 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:00.057656 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:00:00.111948 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:00:00.139136 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:00:00.190379 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:00:00.244265 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:00:00.271282 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:00:00.820230 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 14:00:00.826256 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:00:00.837488 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:00:00.877896 tst handover.py: using LAC 28880 14:00:01.007081 tst handover.py: using RAC 65 14:00:01.134342 tst handover.py: using CellId 28880 14:00:01.283466 tst handover.py: using BVCI 28881 14:00:01.426249 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:00:01.475502 tst handover.py: using LAC 28881 14:00:01.628609 tst handover.py: using RAC 66 14:00:01.769778 tst handover.py: using CellId 28881 14:00:01.900811 tst handover.py: using BVCI 28882 14:00:02.022138 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:00:02.034264 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:00:02.046301 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:00:02.060644 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:00:02.073794 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:00:02.085860 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:00:02.209958 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:00:02.328288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:02.796290 run create_hlr_db(pid=16453): Launched 14:00:02.918477 bus /sierra_2: Setting Powered False 14:00:03.980294 run create_hlr_db(pid=16453): Terminated: ok {rc=0} 14:00:04.380230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16455): Launched 14:00:04.679589 run osmo-hlr_10.42.42.2(pid=16456): Launched 14:00:04.804739 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:05.326535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16458): Launched 14:00:05.645331 run osmo-stp_10.42.42.5(pid=16459): Launched 14:00:05.769085 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:06.321266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16461): Launched 14:00:06.639869 run osmo-msc_10.42.42.6(pid=16462): Launched 14:00:06.819944 run osmo-stp_10.42.42.5(pid=16459): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16459)] 14:00:06.956177 run osmo-stp_10.42.42.5(pid=16459): stdout: | (launched: 2022-12-10_14:00:05.587529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:07.091656 run osmo-stp_10.42.42.5(pid=16459): stderr: | [0;m[38;5;43m20221210140005777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140005777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140005778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140005778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140005778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140005778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140005779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:07.226216 run osmo-stp_10.42.42.5(pid=16459): stdout: | (launched: 2022-12-10_14:00:05.587529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:07.353233 run osmo-stp_10.42.42.5(pid=16459): stderr: | [0;m[38;5;43m20221210140005777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140005777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140005778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140005778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140005778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140005778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140005779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:07.505212 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16459): Process ended prematurely: osmo-stp_10.42.42.5(pid=16459) [trial-2375↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16459)] [trial-2375↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 14:00:07.513862 tst handover.py:18: Test FAILED (6.7 sec) 14:00:07.541372 run osmo-hlr_10.42.42.2(pid=16456): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16456)] 14:00:07.591629 run osmo-hlr_10.42.42.2(pid=16456): stdout: | (launched: 2022-12-10_14:00:04.624790) 14:00:07.643074 run osmo-hlr_10.42.42.2(pid=16456): stderr: | [0;m[1;31m20221210140004816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140004816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140004816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140004816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140004816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140004816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140004829 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140004837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140004837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140004838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:07.714768 run osmo-msc_10.42.42.6(pid=16462): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16462)] 14:00:07.764641 run osmo-msc_10.42.42.6(pid=16462): stdout: | (launched: 2022-12-10_14:00:06.582137) 14:00:07.815951 run osmo-msc_10.42.42.6(pid=16462): stderr: | [0;m[38;5;43m20221210140006902 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140006903 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5869717c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140006903 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140006903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140006903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140006903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140006905 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140006905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140006905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140006906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:07.867661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16455): Terminating (SIGTERM) 14:00:07.909202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16458): Terminating (SIGTERM) 14:00:07.950876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16461): Terminating (SIGTERM) 14:00:07.992679 --- ParallelTerminationStrategy: PID 16455 died... 14:00:08.012386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16455): Terminated: ok {rc=0} 14:00:08.058227 --- ParallelTerminationStrategy: PID 16458 died... 14:00:08.077399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16458): Terminated: ok {rc=0} 14:00:08.123137 --- ParallelTerminationStrategy: PID 16461 died... 14:00:08.142325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16461): Terminated: ok {rc=0} 14:00:08.229422 bus /sierra_3: Setting Powered False 14:00:09.326020 bus /sierra_3: Setting Powered False 14:00:10.439443 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 14:00:11.696135 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:11.702778 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:00:11.756432 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:00:11.783161 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:00:11.840291 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:00:11.894293 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:00:11.921052 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:00:12.467227 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 14:00:12.472480 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:00:12.483606 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:00:12.521988 tst handover.py: using LAC 28882 14:00:12.648396 tst handover.py: using RAC 67 14:00:12.772172 tst handover.py: using CellId 28882 14:00:12.898626 tst handover.py: using BVCI 28883 14:00:13.014791 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:00:13.061375 tst handover.py: using LAC 28883 14:00:13.185951 tst handover.py: using RAC 68 14:00:13.312147 tst handover.py: using CellId 28883 14:00:13.436703 tst handover.py: using BVCI 28884 14:00:13.553332 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:00:13.564432 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:00:13.575704 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:00:13.587068 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:00:13.598410 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:00:13.609665 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:00:13.724351 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:00:13.843429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:14.310742 run create_hlr_db(pid=16467): Launched 14:00:14.433050 bus /sierra_2: Setting Powered False 14:00:15.495891 run create_hlr_db(pid=16467): Terminated: ok {rc=0} 14:00:15.939717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16469): Launched 14:00:16.301709 run osmo-hlr_10.42.42.2(pid=16470): Launched 14:00:16.562917 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:17.286474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16472): Launched 14:00:17.606860 run osmo-stp_10.42.42.5(pid=16473): Launched 14:00:17.729195 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:18.275964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16475): Launched 14:00:18.577570 run osmo-msc_10.42.42.6(pid=16476): Launched 14:00:18.747442 run osmo-stp_10.42.42.5(pid=16473): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16473)] 14:00:18.874316 run osmo-stp_10.42.42.5(pid=16473): stdout: | (launched: 2022-12-10_14:00:17.548846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:19.003639 run osmo-stp_10.42.42.5(pid=16473): stderr: | [0;m[38;5;43m20221210140017738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140017738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140017739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140017739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140017740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140017740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140017740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:19.128296 run osmo-stp_10.42.42.5(pid=16473): stdout: | (launched: 2022-12-10_14:00:17.548846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:19.246771 run osmo-stp_10.42.42.5(pid=16473): stderr: | [0;m[38;5;43m20221210140017738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140017738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140017739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140017739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140017740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140017740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140017740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:19.388770 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16473): Process ended prematurely: osmo-stp_10.42.42.5(pid=16473) [trial-2375↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16473)] [trial-2375↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 14:00:19.396771 tst handover.py:18: Test FAILED (6.9 sec) 14:00:19.422366 run osmo-hlr_10.42.42.2(pid=16470): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16470)] 14:00:19.469236 run osmo-hlr_10.42.42.2(pid=16470): stdout: | (launched: 2022-12-10_14:00:16.230946) 14:00:19.517983 run osmo-hlr_10.42.42.2(pid=16470): stderr: | [0;m[1;31m20221210140016638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140016638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140016638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140016638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140016638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140016638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140016651 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140016665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140016666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140016666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:19.585878 run osmo-msc_10.42.42.6(pid=16476): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16476)] 14:00:19.632737 run osmo-msc_10.42.42.6(pid=16476): stdout: | (launched: 2022-12-10_14:00:18.523098) 14:00:19.681402 run osmo-msc_10.42.42.6(pid=16476): stderr: | [0;m[38;5;43m20221210140018792 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140018792 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7d4bd86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140018792 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140018792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140018792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140018792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140018795 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140018796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140018796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140018796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:19.730320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16469): Terminating (SIGTERM) 14:00:19.769078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16472): Terminating (SIGTERM) 14:00:19.807846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16475): Terminating (SIGTERM) 14:00:19.846941 --- ParallelTerminationStrategy: PID 16469 died... 14:00:19.865734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16469): Terminated: ok {rc=0} 14:00:19.909247 --- ParallelTerminationStrategy: PID 16472 died... 14:00:19.927471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16472): Terminated: ok {rc=0} 14:00:19.970186 --- ParallelTerminationStrategy: PID 16475 died... 14:00:19.988347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16475): Terminated: ok {rc=0} 14:00:20.072525 bus /sierra_3: Setting Powered False 14:00:21.171733 bus /sierra_3: Setting Powered False 14:00:22.285111 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 14:00:23.543730 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:23.549341 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 14:00:23.588174 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 14:00:23.615444 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 14:00:23.667691 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 14:00:23.703573 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 14:00:23.729880 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 14:00:24.282396 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 14:00:24.288021 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:00:24.299376 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 14:00:24.335948 tst handover.py: using LAC 28884 14:00:24.460514 tst handover.py: using RAC 69 14:00:24.584575 tst handover.py: using CellId 28884 14:00:24.708171 tst handover.py: using BVCI 28885 14:00:24.825852 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 14:00:24.858264 tst handover.py: using LAC 28885 14:00:24.981454 tst handover.py: using RAC 70 14:00:25.099561 tst handover.py: using CellId 28885 14:00:25.215857 tst handover.py: using BVCI 28886 14:00:25.323280 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:00:25.333891 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:00:25.344325 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:00:25.354731 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:00:25.365095 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:00:25.375427 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 14:00:25.493778 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 14:00:25.610947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:26.078961 run create_hlr_db(pid=16481): Launched 14:00:26.201374 bus /sierra_2: Setting Powered False 14:00:27.264011 run create_hlr_db(pid=16481): Terminated: ok {rc=0} 14:00:27.666412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16483): Launched 14:00:27.965731 run osmo-hlr_10.42.42.2(pid=16484): Launched 14:00:28.079756 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:28.568846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16486): Launched 14:00:28.867151 run osmo-stp_10.42.42.5(pid=16487): Launched 14:00:28.981439 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:29.496917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16489): Launched 14:00:29.796137 run osmo-msc_10.42.42.6(pid=16490): Launched 14:00:29.963725 run osmo-stp_10.42.42.5(pid=16487): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16487)] 14:00:30.091587 run osmo-stp_10.42.42.5(pid=16487): stdout: | (launched: 2022-12-10_14:00:28.812652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:30.218309 run osmo-stp_10.42.42.5(pid=16487): stderr: | [0;m[38;5;43m20221210140028983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140028984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140028984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140028984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140028985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140028985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140028985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:30.342995 run osmo-stp_10.42.42.5(pid=16487): stdout: | (launched: 2022-12-10_14:00:28.812652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:30.461521 run osmo-stp_10.42.42.5(pid=16487): stderr: | [0;m[38;5;43m20221210140028983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140028984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140028984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140028984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140028985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140028985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140028985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:30.603346 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16487): Process ended prematurely: osmo-stp_10.42.42.5(pid=16487) [trial-2375↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16487)] [trial-2375↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 14:00:30.611600 tst handover.py:18: Test FAILED (6.3 sec) 14:00:30.636861 run osmo-hlr_10.42.42.2(pid=16484): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16484)] 14:00:30.683587 run osmo-hlr_10.42.42.2(pid=16484): stdout: | (launched: 2022-12-10_14:00:27.911019) 14:00:30.731838 run osmo-hlr_10.42.42.2(pid=16484): stderr: | [0;m[1;31m20221210140028088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140028088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140028088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140028088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140028088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140028088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140028100 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140028109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140028109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140028109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:30.799595 run osmo-msc_10.42.42.6(pid=16490): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16490)] 14:00:30.854728 run osmo-msc_10.42.42.6(pid=16490): stdout: | (launched: 2022-12-10_14:00:29.741408) 14:00:30.915584 run osmo-msc_10.42.42.6(pid=16490): stderr: | [0;m[38;5;43m20221210140030013 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140030013 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe08dcdbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140030014 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140030014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140030014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140030014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140030016 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140030016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140030016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140030016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:30.969426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16483): Terminating (SIGTERM) 14:00:31.014842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16486): Terminating (SIGTERM) 14:00:31.060395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16489): Terminating (SIGTERM) 14:00:31.106721 --- ParallelTerminationStrategy: PID 16483 died... 14:00:31.127228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16483): Terminated: ok {rc=0} 14:00:31.177238 --- ParallelTerminationStrategy: PID 16486 died... 14:00:31.198540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16486): Terminated: ok {rc=0} 14:00:31.247322 --- ParallelTerminationStrategy: PID 16489 died... 14:00:31.267469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16489): Terminated: ok {rc=0} 14:00:31.359497 bus /sierra_3: Setting Powered False 14:00:32.458846 bus /sierra_3: Setting Powered False 14:00:33.571603 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 14:00:34.815533 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:34.821175 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 14:00:34.872736 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 14:00:34.899772 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 14:00:34.953706 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 14:00:35.005111 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 14:00:35.030985 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 14:00:35.580079 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 14:00:35.586442 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:00:35.598160 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:00:35.634964 tst handover.py: using LAC 28886 14:00:35.761146 tst handover.py: using RAC 71 14:00:35.889276 tst handover.py: using CellId 28886 14:00:36.016826 tst handover.py: using BVCI 28887 14:00:36.135558 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:00:36.185441 tst handover.py: using LAC 28887 14:00:36.307515 tst handover.py: using RAC 72 14:00:36.425733 tst handover.py: using CellId 28887 14:00:36.541737 tst handover.py: using BVCI 28888 14:00:36.650658 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:00:36.661377 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:00:36.671839 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:00:36.682346 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:00:36.692750 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:00:36.703226 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:00:36.821995 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:00:36.939119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:37.378756 run create_hlr_db(pid=16496): Launched 14:00:37.501315 bus /sierra_2: Setting Powered False 14:00:38.560744 run create_hlr_db(pid=16496): Terminated: ok {rc=0} 14:00:38.968882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16498): Launched 14:00:39.288242 run osmo-hlr_10.42.42.2(pid=16499): Launched 14:00:39.410765 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:39.935992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16501): Launched 14:00:40.254950 run osmo-stp_10.42.42.5(pid=16502): Launched 14:00:40.377267 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:40.925509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16504): Launched 14:00:41.245148 run osmo-msc_10.42.42.6(pid=16505): Launched 14:00:41.423124 run osmo-stp_10.42.42.5(pid=16502): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16502)] 14:00:41.558997 run osmo-stp_10.42.42.5(pid=16502): stdout: | (launched: 2022-12-10_14:00:40.196916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:41.695668 run osmo-stp_10.42.42.5(pid=16502): stderr: | [0;m[38;5;43m20221210140040389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140040389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140040389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140040389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140040390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140040390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140040390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:41.830848 run osmo-stp_10.42.42.5(pid=16502): stdout: | (launched: 2022-12-10_14:00:40.196916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:41.957836 run osmo-stp_10.42.42.5(pid=16502): stderr: | [0;m[38;5;43m20221210140040389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140040389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140040389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140040389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140040390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140040390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140040390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:42.109313 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16502): Process ended prematurely: osmo-stp_10.42.42.5(pid=16502) [trial-2375↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16502)] [trial-2375↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 14:00:42.118220 tst handover.py:18: Test FAILED (6.5 sec) 14:00:42.145477 run osmo-hlr_10.42.42.2(pid=16499): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16499)] 14:00:42.195723 run osmo-hlr_10.42.42.2(pid=16499): stdout: | (launched: 2022-12-10_14:00:39.230608) 14:00:42.247238 run osmo-hlr_10.42.42.2(pid=16499): stderr: | [0;m[1;31m20221210140039430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140039430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140039430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140039430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140039430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140039430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140039441 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140039449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140039450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140039450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:42.319201 run osmo-msc_10.42.42.6(pid=16505): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16505)] 14:00:42.368914 run osmo-msc_10.42.42.6(pid=16505): stdout: | (launched: 2022-12-10_14:00:41.187100) 14:00:42.420172 run osmo-msc_10.42.42.6(pid=16505): stderr: | [0;m[38;5;43m20221210140041506 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140041506 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f508f71fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140041507 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140041507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140041507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140041507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140041509 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140041509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140041509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140041509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:42.471761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16498): Terminating (SIGTERM) 14:00:42.512929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16501): Terminating (SIGTERM) 14:00:42.554749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16504): Terminating (SIGTERM) 14:00:42.596415 --- ParallelTerminationStrategy: PID 16498 died... 14:00:42.616533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16498): Terminated: ok {rc=0} 14:00:42.662496 --- ParallelTerminationStrategy: PID 16501 died... 14:00:42.682049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16501): Terminated: ok {rc=0} 14:00:42.727686 --- ParallelTerminationStrategy: PID 16504 died... 14:00:42.746974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16504): Terminated: ok {rc=0} 14:00:42.833638 bus /sierra_3: Setting Powered False 14:00:43.930213 bus /sierra_3: Setting Powered False 14:00:45.045916 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:00:46.340340 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:46.346804 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:00:46.399869 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:00:46.429533 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:00:46.483603 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:00:46.539286 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:00:46.572024 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:00:47.109157 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:00:47.115190 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:00:47.130536 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:00:47.170722 tst handover.py: using LAC 28888 14:00:47.302397 tst handover.py: using RAC 73 14:00:47.419014 tst handover.py: using CellId 28888 14:00:47.535437 tst handover.py: using BVCI 28889 14:00:47.644213 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:00:47.686590 tst handover.py: using LAC 28889 14:00:47.804522 tst handover.py: using RAC 74 14:00:47.925367 tst handover.py: using CellId 28889 14:00:48.052339 tst handover.py: using BVCI 28890 14:00:48.169814 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:00:48.181263 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:00:48.192530 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:00:48.204314 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:00:48.216422 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:00:48.228279 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:00:48.345608 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:00:48.460742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:48.899915 run create_hlr_db(pid=16510): Launched 14:00:49.022428 bus /sierra_2: Setting Powered False 14:00:50.081725 run create_hlr_db(pid=16510): Terminated: ok {rc=0} 14:00:50.491392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16512): Launched 14:00:50.811567 run osmo-hlr_10.42.42.2(pid=16513): Launched 14:00:50.933898 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:51.460616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16515): Launched 14:00:51.780526 run osmo-stp_10.42.42.5(pid=16516): Launched 14:00:51.903518 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:52.454762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16518): Launched 14:00:52.775803 run osmo-msc_10.42.42.6(pid=16519): Launched 14:00:52.955044 run osmo-stp_10.42.42.5(pid=16516): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16516)] 14:00:53.091456 run osmo-stp_10.42.42.5(pid=16516): stdout: | (launched: 2022-12-10_14:00:51.722620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:53.227831 run osmo-stp_10.42.42.5(pid=16516): stderr: | [0;m[38;5;43m20221210140051918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140051918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140051919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140051919 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140051919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140051919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140051919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:53.363313 run osmo-stp_10.42.42.5(pid=16516): stdout: | (launched: 2022-12-10_14:00:51.722620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:53.491103 run osmo-stp_10.42.42.5(pid=16516): stderr: | [0;m[38;5;43m20221210140051918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140051918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140051919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140051919 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140051919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140051919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140051919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:53.645073 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16516): Process ended prematurely: osmo-stp_10.42.42.5(pid=16516) [trial-2375↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16516)] [trial-2375↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 14:00:53.654112 tst handover.py:18: Test FAILED (6.5 sec) 14:00:53.682235 run osmo-hlr_10.42.42.2(pid=16513): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16513)] 14:00:53.732524 run osmo-hlr_10.42.42.2(pid=16513): stdout: | (launched: 2022-12-10_14:00:50.753865) 14:00:53.784316 run osmo-hlr_10.42.42.2(pid=16513): stderr: | [0;m[1;31m20221210140050950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140050950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140050950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140050950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140050950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140050950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140050962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140050970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140050970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140050970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:53.856682 run osmo-msc_10.42.42.6(pid=16519): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16519)] 14:00:53.906879 run osmo-msc_10.42.42.6(pid=16519): stdout: | (launched: 2022-12-10_14:00:52.717716) 14:00:53.958623 run osmo-msc_10.42.42.6(pid=16519): stderr: | [0;m[38;5;43m20221210140053039 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140053039 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc30c629c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140053039 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140053040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140053040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140053040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140053042 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140053042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140053042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140053042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:54.010936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16512): Terminating (SIGTERM) 14:00:54.052643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16515): Terminating (SIGTERM) 14:00:54.094853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16518): Terminating (SIGTERM) 14:00:54.137193 --- ParallelTerminationStrategy: PID 16512 died... 14:00:54.156892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16512): Terminated: ok {rc=0} 14:00:54.203954 --- ParallelTerminationStrategy: PID 16515 died... 14:00:54.223465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16515): Terminated: ok {rc=0} 14:00:54.269906 --- ParallelTerminationStrategy: PID 16518 died... 14:00:54.289391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16518): Terminated: ok {rc=0} 14:00:54.375711 bus /sierra_3: Setting Powered False 14:00:55.473133 bus /sierra_3: Setting Powered False 14:00:56.587626 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:00:57.838917 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:57.843954 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:00:57.893294 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:00:57.919439 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:00:57.970890 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:00:58.020507 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:00:58.046444 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:00:58.596592 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:00:58.601894 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:00:58.612613 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:00:58.646117 tst handover.py: using LAC 28890 14:00:58.764485 tst handover.py: using RAC 75 14:00:58.882802 tst handover.py: using CellId 28890 14:00:59.007666 tst handover.py: using BVCI 28891 14:00:59.117401 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:00:59.164410 tst handover.py: using LAC 28891 14:00:59.281581 tst handover.py: using RAC 76 14:00:59.398060 tst handover.py: using CellId 28891 14:00:59.514705 tst handover.py: using BVCI 28892 14:00:59.624884 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:00:59.635744 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:00:59.646364 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:00:59.657028 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:00:59.667663 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:00:59.678321 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:00:59.795402 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:00:59.912298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:00.350902 run create_hlr_db(pid=16524): Launched 14:01:00.473657 bus /sierra_2: Setting Powered False 14:01:01.531889 run create_hlr_db(pid=16524): Terminated: ok {rc=0} 14:01:02.028635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16526): Launched 14:01:02.333442 run osmo-hlr_10.42.42.2(pid=16527): Launched 14:01:02.448116 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:02.961714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16529): Launched 14:01:03.261933 run osmo-stp_10.42.42.5(pid=16530): Launched 14:01:03.376822 run osmo-msc_10.42.42.6: Starting osmo-msc 14:01:03.891459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16532): Launched 14:01:04.190261 run osmo-msc_10.42.42.6(pid=16533): Launched 14:01:04.357487 run osmo-stp_10.42.42.5(pid=16530): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16530)] 14:01:04.484146 run osmo-stp_10.42.42.5(pid=16530): stdout: | (launched: 2022-12-10_14:01:03.207286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:04.610559 run osmo-stp_10.42.42.5(pid=16530): stderr: | [0;m[38;5;43m20221210140103377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140103377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140103377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140103378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140103378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140103378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140103378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:04.735079 run osmo-stp_10.42.42.5(pid=16530): stdout: | (launched: 2022-12-10_14:01:03.207286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:04.853874 run osmo-stp_10.42.42.5(pid=16530): stderr: | [0;m[38;5;43m20221210140103377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140103377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140103377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140103378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140103378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140103378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140103378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:04.995698 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16530): Process ended prematurely: osmo-stp_10.42.42.5(pid=16530) [trial-2375↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16530)] [trial-2375↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 14:01:05.004002 tst handover.py:18: Test FAILED (6.4 sec) 14:01:05.030064 run osmo-hlr_10.42.42.2(pid=16527): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16527)] 14:01:05.077739 run osmo-hlr_10.42.42.2(pid=16527): stdout: | (launched: 2022-12-10_14:01:02.278658) 14:01:05.126968 run osmo-hlr_10.42.42.2(pid=16527): stderr: | [0;m[1;31m20221210140102453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140102453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140102453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140102453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140102453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140102453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140102465 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140102474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140102474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140102474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:05.195478 run osmo-msc_10.42.42.6(pid=16533): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16533)] 14:01:05.242783 run osmo-msc_10.42.42.6(pid=16533): stdout: | (launched: 2022-12-10_14:01:04.135519) 14:01:05.291940 run osmo-msc_10.42.42.6(pid=16533): stderr: | [0;m[38;5;43m20221210140104405 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140104405 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa870eeec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140104406 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140104406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140104407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140104407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140104409 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140104409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140104409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140104409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:05.341689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16526): Terminating (SIGTERM) 14:01:05.380822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16529): Terminating (SIGTERM) 14:01:05.420030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16532): Terminating (SIGTERM) 14:01:05.459573 --- ParallelTerminationStrategy: PID 16526 died... 14:01:05.478308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16526): Terminated: ok {rc=0} 14:01:05.521967 --- ParallelTerminationStrategy: PID 16529 died... 14:01:05.540378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16529): Terminated: ok {rc=0} 14:01:05.583420 --- ParallelTerminationStrategy: PID 16532 died... 14:01:05.601864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16532): Terminated: ok {rc=0} 14:01:05.684076 bus /sierra_3: Setting Powered False 14:01:06.781294 bus /sierra_3: Setting Powered False 14:01:07.896926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 14:01:09.157069 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:01:09.163731 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:01:09.203800 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:01:09.230742 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:01:09.282118 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:01:09.321305 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:01:09.348810 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:01:09.898806 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 14:01:09.904362 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:01:09.915574 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 14:01:09.950563 tst handover.py: using LAC 28892 14:01:10.074310 tst handover.py: using RAC 77 14:01:10.198176 tst handover.py: using CellId 28892 14:01:10.321593 tst handover.py: using BVCI 28893 14:01:10.431125 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 14:01:10.465279 tst handover.py: using LAC 28893 14:01:10.592486 tst handover.py: using RAC 78 14:01:10.719704 tst handover.py: using CellId 28893 14:01:10.845465 tst handover.py: using BVCI 28894 14:01:10.955181 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:01:10.966094 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:01:10.976589 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:01:10.987364 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:01:10.999063 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:01:11.009464 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 14:01:11.126643 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 14:01:11.242387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:11.681803 run create_hlr_db(pid=16538): Launched 14:01:11.804625 bus /sierra_2: Setting Powered False 14:01:12.864104 run create_hlr_db(pid=16538): Terminated: ok {rc=0} 14:01:13.272101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16540): Launched 14:01:13.592590 run osmo-hlr_10.42.42.2(pid=16541): Launched 14:01:13.715635 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:14.239519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16543): Launched 14:01:14.559511 run osmo-stp_10.42.42.5(pid=16544): Launched 14:01:14.682907 run osmo-msc_10.42.42.6: Starting osmo-msc 14:01:15.232780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16546): Launched 14:01:15.552123 run osmo-msc_10.42.42.6(pid=16547): Launched 14:01:15.731783 run osmo-stp_10.42.42.5(pid=16544): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16544)] 14:01:15.961740 run osmo-stp_10.42.42.5(pid=16544): stdout: | (launched: 2022-12-10_14:01:14.501628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:16.203638 run osmo-stp_10.42.42.5(pid=16544): stderr: | [0;m[38;5;43m20221210140114693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140114693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140114693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140114693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140114694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140114694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140114694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:16.362669 run osmo-stp_10.42.42.5(pid=16544): stdout: | (launched: 2022-12-10_14:01:14.501628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:16.487750 run osmo-stp_10.42.42.5(pid=16544): stderr: | [0;m[38;5;43m20221210140114693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140114693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140114693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140114693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140114694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140114694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140114694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:16.635905 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16544): Process ended prematurely: osmo-stp_10.42.42.5(pid=16544) [trial-2375↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16544)] [trial-2375↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 14:01:16.644667 tst handover.py:18: Test FAILED (6.7 sec) 14:01:16.672236 run osmo-hlr_10.42.42.2(pid=16541): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16541)] 14:01:16.722415 run osmo-hlr_10.42.42.2(pid=16541): stdout: | (launched: 2022-12-10_14:01:13.533512) 14:01:16.772350 run osmo-hlr_10.42.42.2(pid=16541): stderr: | [0;m[1;31m20221210140113732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140113732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140113732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140113732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140113732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140113732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140113744 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140113752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140113752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140113752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:16.844484 run osmo-msc_10.42.42.6(pid=16547): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16547)] 14:01:16.894054 run osmo-msc_10.42.42.6(pid=16547): stdout: | (launched: 2022-12-10_14:01:15.494114) 14:01:16.946382 run osmo-msc_10.42.42.6(pid=16547): stderr: | [0;m[38;5;43m20221210140115816 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140115816 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff14ca0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140115816 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140115816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140115817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140115817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140115819 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140115819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140115819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140115819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:16.999652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16540): Terminating (SIGTERM) 14:01:17.042050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16543): Terminating (SIGTERM) 14:01:17.085793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16546): Terminating (SIGTERM) 14:01:17.129458 --- ParallelTerminationStrategy: PID 16540 died... 14:01:17.149338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16540): Terminated: ok {rc=0} 14:01:17.197921 --- ParallelTerminationStrategy: PID 16543 died... 14:01:17.217234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16543): Terminated: ok {rc=0} 14:01:17.263629 --- ParallelTerminationStrategy: PID 16546 died... 14:01:17.283268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16546): Terminated: ok {rc=0} 14:01:17.367527 bus /sierra_3: Setting Powered False 14:01:18.464856 bus /sierra_3: Setting Powered False 14:01:19.581391 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 14:01:20.818565 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:01:20.823484 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:01:20.872768 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:01:20.899225 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:01:20.950560 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:01:21.000287 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:01:21.026381 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:01:21.580577 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 14:01:21.587107 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:01:21.598282 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:01:21.632895 tst handover.py: using LAC 28894 14:01:21.750654 tst handover.py: using RAC 79 14:01:21.873712 tst handover.py: using CellId 28894 14:01:21.991873 tst handover.py: using BVCI 28895 14:01:22.100802 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:01:22.150488 tst handover.py: using LAC 28895 14:01:22.268185 tst handover.py: using RAC 80 14:01:22.394540 tst handover.py: using CellId 28895 14:01:22.520372 tst handover.py: using BVCI 28896 14:01:22.637808 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:01:22.648818 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:01:22.659922 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:01:22.671497 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:01:22.682892 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:01:22.693913 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:01:22.813120 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:01:22.928842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:23.365958 run create_hlr_db(pid=16552): Launched 14:01:23.488478 bus /sierra_2: Setting Powered False 14:01:24.548197 run create_hlr_db(pid=16552): Terminated: ok {rc=0} 14:01:24.956519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16554): Launched 14:01:25.275169 run osmo-hlr_10.42.42.2(pid=16555): Launched 14:01:25.397795 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:25.924787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16557): Launched 14:01:26.243604 run osmo-stp_10.42.42.5(pid=16558): Launched 14:01:26.366329 run osmo-msc_10.42.42.6: Starting osmo-msc 14:01:26.916832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16560): Launched 14:01:27.235133 run osmo-msc_10.42.42.6(pid=16561): Launched 14:01:27.413768 run osmo-stp_10.42.42.5(pid=16558): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16558)] 14:01:27.551002 run osmo-stp_10.42.42.5(pid=16558): stdout: | (launched: 2022-12-10_14:01:26.185954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:27.687715 run osmo-stp_10.42.42.5(pid=16558): stderr: | [0;m[38;5;43m20221210140126375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140126375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140126376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140126376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140126378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140126379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140126379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:27.822719 run osmo-stp_10.42.42.5(pid=16558): stdout: | (launched: 2022-12-10_14:01:26.185954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:27.949516 run osmo-stp_10.42.42.5(pid=16558): stderr: | [0;m[38;5;43m20221210140126375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140126375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140126376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140126376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140126378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140126379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140126379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:28.101540 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16558): Process ended prematurely: osmo-stp_10.42.42.5(pid=16558) [trial-2375↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16558)] [trial-2375↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 14:01:28.110617 tst handover.py:18: Test FAILED (6.5 sec) 14:01:28.138415 run osmo-hlr_10.42.42.2(pid=16555): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16555)] 14:01:28.188178 run osmo-hlr_10.42.42.2(pid=16555): stdout: | (launched: 2022-12-10_14:01:25.217687) 14:01:28.239471 run osmo-hlr_10.42.42.2(pid=16555): stderr: | [0;m[1;31m20221210140125415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140125415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140125415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140125415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140125415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140125415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140125429 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140125439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140125439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140125439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:28.310897 run osmo-msc_10.42.42.6(pid=16561): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16561)] 14:01:28.360420 run osmo-msc_10.42.42.6(pid=16561): stdout: | (launched: 2022-12-10_14:01:27.177494) 14:01:28.412129 run osmo-msc_10.42.42.6(pid=16561): stderr: | [0;m[38;5;43m20221210140127498 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140127498 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc928c67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140127498 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140127498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140127498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140127498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140127500 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140127500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140127501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140127501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:28.464044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16554): Terminating (SIGTERM) 14:01:28.505077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16557): Terminating (SIGTERM) 14:01:28.546576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16560): Terminating (SIGTERM) 14:01:28.588499 --- ParallelTerminationStrategy: PID 16554 died... 14:01:28.607923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16554): Terminated: ok {rc=0} 14:01:28.654308 --- ParallelTerminationStrategy: PID 16557 died... 14:01:28.673592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16557): Terminated: ok {rc=0} 14:01:28.719178 --- ParallelTerminationStrategy: PID 16560 died... 14:01:28.738286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16560): Terminated: ok {rc=0} 14:01:28.825476 bus /sierra_3: Setting Powered False 14:01:29.921892 bus /sierra_3: Setting Powered False 14:01:31.039447 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 14:01:32.293923 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:01:32.299695 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:01:32.351934 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:01:32.379370 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:01:32.430696 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:01:32.481089 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:01:32.508120 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:01:33.059136 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 14:01:33.064602 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:01:33.075857 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:01:33.110816 tst handover.py: using LAC 28896 14:01:33.237223 tst handover.py: using RAC 81 14:01:33.363265 tst handover.py: using CellId 28896 14:01:33.488867 tst handover.py: using BVCI 28897 14:01:33.606317 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:01:33.655214 tst handover.py: using LAC 28897 14:01:33.781114 tst handover.py: using RAC 82 14:01:33.906081 tst handover.py: using CellId 28897 14:01:34.032295 tst handover.py: using BVCI 28898 14:01:34.148322 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:01:34.159364 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:01:34.170484 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:01:34.181749 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:01:34.193240 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:01:34.204330 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:01:34.319173 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:01:34.436745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:34.904772 run create_hlr_db(pid=16566): Launched 14:01:35.027390 bus /sierra_2: Setting Powered False 14:01:36.090124 run create_hlr_db(pid=16566): Terminated: ok {rc=0} 14:01:36.491689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16568): Launched 14:01:36.792007 run osmo-hlr_10.42.42.2(pid=16569): Launched 14:01:36.906647 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:37.396832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16571): Launched 14:01:37.696449 run osmo-stp_10.42.42.5(pid=16572): Launched 14:01:37.810191 run osmo-msc_10.42.42.6: Starting osmo-msc 14:01:38.324494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16574): Launched 14:01:38.623252 run osmo-msc_10.42.42.6(pid=16575): Launched 14:01:38.791384 run osmo-stp_10.42.42.5(pid=16572): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16572)] 14:01:38.918812 run osmo-stp_10.42.42.5(pid=16572): stdout: | (launched: 2022-12-10_14:01:37.641882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:39.045263 run osmo-stp_10.42.42.5(pid=16572): stderr: | [0;m[38;5;43m20221210140137812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140137812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140137812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140137813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140137813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140137813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140137813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:39.169759 run osmo-stp_10.42.42.5(pid=16572): stdout: | (launched: 2022-12-10_14:01:37.641882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:39.288402 run osmo-stp_10.42.42.5(pid=16572): stderr: | [0;m[38;5;43m20221210140137812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140137812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140137812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140137813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140137813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140137813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140137813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:39.430540 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16572): Process ended prematurely: osmo-stp_10.42.42.5(pid=16572) [trial-2375↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16572)] [trial-2375↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 14:01:39.438768 tst handover.py:18: Test FAILED (6.4 sec) 14:01:39.464675 run osmo-hlr_10.42.42.2(pid=16569): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16569)] 14:01:39.511912 run osmo-hlr_10.42.42.2(pid=16569): stdout: | (launched: 2022-12-10_14:01:36.737343) 14:01:39.561126 run osmo-hlr_10.42.42.2(pid=16569): stderr: | [0;m[1;31m20221210140136913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140136913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140136913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140136913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140136913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140136914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140136929 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140136939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140136939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140136939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:39.629551 run osmo-msc_10.42.42.6(pid=16575): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16575)] 14:01:39.676577 run osmo-msc_10.42.42.6(pid=16575): stdout: | (launched: 2022-12-10_14:01:38.568723) 14:01:39.724665 run osmo-msc_10.42.42.6(pid=16575): stderr: | [0;m[38;5;43m20221210140138841 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140138841 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f891da71c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140138841 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140138841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140138842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140138842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140138843 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140138844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140138844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140138844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:39.773505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16568): Terminating (SIGTERM) 14:01:39.812581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16571): Terminating (SIGTERM) 14:01:39.851735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16574): Terminating (SIGTERM) 14:01:39.891589 --- ParallelTerminationStrategy: PID 16568 died... 14:01:39.910494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16568): Terminated: ok {rc=0} 14:01:39.956680 --- ParallelTerminationStrategy: PID 16571 died... 14:01:39.976469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16571): Terminated: ok {rc=0} 14:01:40.022421 --- ParallelTerminationStrategy: PID 16574 died... 14:01:40.041706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16574): Terminated: ok {rc=0} 14:01:40.129276 bus /sierra_3: Setting Powered False 14:01:41.226221 bus /sierra_3: Setting Powered False 14:01:42.342198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 14:01:43.593440 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:01:43.598835 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 14:01:43.646977 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 14:01:43.673215 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 14:01:43.724023 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 14:01:43.771899 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 14:01:43.798257 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 14:01:44.347299 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 14:01:44.353597 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:01:44.364619 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:01:44.398316 tst handover.py: using LAC 28898 14:01:44.526425 tst handover.py: using RAC 83 14:01:44.653371 tst handover.py: using CellId 28898 14:01:44.772781 tst handover.py: using BVCI 28899 14:01:44.883164 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:01:44.931494 tst handover.py: using LAC 28899 14:01:45.050609 tst handover.py: using RAC 84 14:01:45.170524 tst handover.py: using CellId 28899 14:01:45.290540 tst handover.py: using BVCI 28900 14:01:45.401206 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:01:45.411747 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:01:45.422329 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:01:45.432851 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:01:45.443436 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:01:45.453887 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:01:45.567881 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:01:45.686719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:46.207286 run create_hlr_db(pid=16580): Launched 14:01:46.357272 bus /sierra_2: Setting Powered False 14:01:47.416422 run create_hlr_db(pid=16580): Terminated: ok {rc=0} 14:01:47.809421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16582): Launched 14:01:48.110531 run osmo-hlr_10.42.42.2(pid=16583): Launched 14:01:48.225408 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:48.728623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16585): Launched 14:01:49.028493 run osmo-stp_10.42.42.5(pid=16586): Launched 14:01:49.143615 run osmo-msc_10.42.42.6: Starting osmo-msc 14:01:49.664443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16588): Launched 14:01:49.964328 run osmo-msc_10.42.42.6(pid=16589): Launched 14:01:50.132756 run osmo-stp_10.42.42.5(pid=16586): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16586)] 14:01:50.260237 run osmo-stp_10.42.42.5(pid=16586): stdout: | (launched: 2022-12-10_14:01:48.973871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:50.387429 run osmo-stp_10.42.42.5(pid=16586): stderr: | [0;m[38;5;43m20221210140149143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140149143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140149144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140149144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140149144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140149145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140149145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:50.512193 run osmo-stp_10.42.42.5(pid=16586): stdout: | (launched: 2022-12-10_14:01:48.973871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:50.631288 run osmo-stp_10.42.42.5(pid=16586): stderr: | [0;m[38;5;43m20221210140149143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140149143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140149144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140149144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140149144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140149145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140149145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:50.773996 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16586): Process ended prematurely: osmo-stp_10.42.42.5(pid=16586) [trial-2375↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16586)] [trial-2375↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 14:01:50.782196 tst handover.py:18: Test FAILED (6.4 sec) 14:01:50.808120 run osmo-hlr_10.42.42.2(pid=16583): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16583)] 14:01:50.855211 run osmo-hlr_10.42.42.2(pid=16583): stdout: | (launched: 2022-12-10_14:01:48.055494) 14:01:50.904002 run osmo-hlr_10.42.42.2(pid=16583): stderr: | [0;m[1;31m20221210140148230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140148230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140148230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140148230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140148230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140148230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140148242 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140148251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140148251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140148251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:50.972159 run osmo-msc_10.42.42.6(pid=16589): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16589)] 14:01:51.019136 run osmo-msc_10.42.42.6(pid=16589): stdout: | (launched: 2022-12-10_14:01:49.909409) 14:01:51.067472 run osmo-msc_10.42.42.6(pid=16589): stderr: | [0;m[38;5;43m20221210140150180 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140150180 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f73fa23cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140150181 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140150181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140150181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140150181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140150184 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140150184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140150184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140150184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:51.116331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16582): Terminating (SIGTERM) 14:01:51.155284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16585): Terminating (SIGTERM) 14:01:51.194562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16588): Terminating (SIGTERM) 14:01:51.233750 --- ParallelTerminationStrategy: PID 16582 died... 14:01:51.252392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16582): Terminated: ok {rc=0} 14:01:51.295744 --- ParallelTerminationStrategy: PID 16585 died... 14:01:51.314081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16585): Terminated: ok {rc=0} 14:01:51.357125 --- ParallelTerminationStrategy: PID 16588 died... 14:01:51.375314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16588): Terminated: ok {rc=0} 14:01:51.460001 bus /sierra_3: Setting Powered False 14:01:52.559482 bus /sierra_3: Setting Powered False 14:01:53.673402 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:01:54.930419 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:01:54.936564 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:01:54.980937 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:01:55.007232 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:01:55.059481 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:01:55.103666 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:01:55.129861 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:01:55.679428 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:01:55.685054 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:01:55.696361 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:01:55.730123 tst handover.py: using LAC 28900 14:01:55.848239 tst handover.py: using RAC 85 14:01:55.966552 tst handover.py: using CellId 28900 14:01:56.087532 tst handover.py: using BVCI 28901 14:01:56.198651 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:01:56.242662 tst handover.py: using LAC 28901 14:01:56.360771 tst handover.py: using RAC 86 14:01:56.481648 tst handover.py: using CellId 28901 14:01:56.598602 tst handover.py: using BVCI 28902 14:01:56.707367 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:01:56.718368 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:01:56.729056 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:01:56.739942 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:01:56.751002 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:01:56.762091 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:01:56.881544 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:01:56.999027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:57.437926 run create_hlr_db(pid=16594): Launched 14:01:57.559816 bus /sierra_2: Setting Powered False 14:01:58.619187 run create_hlr_db(pid=16594): Terminated: ok {rc=0} 14:01:59.028636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16596): Launched 14:01:59.348584 run osmo-hlr_10.42.42.2(pid=16597): Launched 14:01:59.470478 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:59.993664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16599): Launched 14:02:00.313733 run osmo-stp_10.42.42.5(pid=16600): Launched 14:02:00.435406 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:01.015251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16602): Launched 14:02:01.343850 run osmo-msc_10.42.42.6(pid=16603): Launched 14:02:01.695680 run osmo-stp_10.42.42.5(pid=16600): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16600)] 14:02:01.944569 run osmo-stp_10.42.42.5(pid=16600): stdout: | (launched: 2022-12-10_14:02:00.255710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:02.112392 run osmo-stp_10.42.42.5(pid=16600): stderr: | [0;m[38;5;43m20221210140200450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140200450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140200450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140200451 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140200451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140200451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140200451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:02.275294 run osmo-stp_10.42.42.5(pid=16600): stdout: | (launched: 2022-12-10_14:02:00.255710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:02.395386 run osmo-stp_10.42.42.5(pid=16600): stderr: | [0;m[38;5;43m20221210140200450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140200450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140200450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140200451 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140200451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140200451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140200451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:02.539720 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16600): Process ended prematurely: osmo-stp_10.42.42.5(pid=16600) [trial-2375↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16600)] [trial-2375↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 14:02:02.548094 tst handover.py:18: Test FAILED (6.9 sec) 14:02:02.574282 run osmo-hlr_10.42.42.2(pid=16597): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16597)] 14:02:02.622139 run osmo-hlr_10.42.42.2(pid=16597): stdout: | (launched: 2022-12-10_14:01:59.290580) 14:02:02.671898 run osmo-hlr_10.42.42.2(pid=16597): stderr: | [0;m[1;31m20221210140159489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140159489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140159489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140159489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140159489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140159489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140159501 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140159509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140159509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140159509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:02.740573 run osmo-msc_10.42.42.6(pid=16603): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16603)] 14:02:02.788088 run osmo-msc_10.42.42.6(pid=16603): stdout: | (launched: 2022-12-10_14:02:01.278734) 14:02:02.837135 run osmo-msc_10.42.42.6(pid=16603): stderr: | [0;m[38;5;43m20221210140201869 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140201869 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4377d2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140201870 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140201870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140201870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140201870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140201872 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140201872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140201872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140201872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:02.886317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16596): Terminating (SIGTERM) 14:02:02.925688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16599): Terminating (SIGTERM) 14:02:02.965742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16602): Terminating (SIGTERM) 14:02:03.005916 --- ParallelTerminationStrategy: PID 16596 died... 14:02:03.024737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16596): Terminated: ok {rc=0} 14:02:03.069009 --- ParallelTerminationStrategy: PID 16599 died... 14:02:03.087740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16599): Terminated: ok {rc=0} 14:02:03.131571 --- ParallelTerminationStrategy: PID 16602 died... 14:02:03.150282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16602): Terminated: ok {rc=0} 14:02:03.236215 bus /sierra_3: Setting Powered False 14:02:04.335439 bus /sierra_3: Setting Powered False 14:02:05.447758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:02:06.703028 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:02:06.708579 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:02:06.759788 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:02:06.787159 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:02:06.843930 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:02:06.895180 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:02:06.922646 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:02:07.468645 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:02:07.474283 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:02:07.485858 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:02:07.520542 tst handover.py: using LAC 28902 14:02:07.646018 tst handover.py: using RAC 87 14:02:07.771136 tst handover.py: using CellId 28902 14:02:07.898155 tst handover.py: using BVCI 28903 14:02:08.015287 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:02:08.063791 tst handover.py: using LAC 28903 14:02:08.193043 tst handover.py: using RAC 88 14:02:08.318382 tst handover.py: using CellId 28903 14:02:08.442577 tst handover.py: using BVCI 28904 14:02:08.559574 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:02:08.571075 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:02:08.582457 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:02:08.594009 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:02:08.605536 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:02:08.617209 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:02:08.734030 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:02:08.848616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:09.286685 run create_hlr_db(pid=16609): Launched 14:02:09.409759 bus /sierra_2: Setting Powered False 14:02:10.470012 run create_hlr_db(pid=16609): Terminated: ok {rc=0} 14:02:10.878461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16611): Launched 14:02:11.198890 run osmo-hlr_10.42.42.2(pid=16612): Launched 14:02:11.314379 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:11.805449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16614): Launched 14:02:12.106468 run osmo-stp_10.42.42.5(pid=16615): Launched 14:02:12.220150 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:12.751048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16617): Launched 14:02:13.049584 run osmo-msc_10.42.42.6(pid=16618): Launched 14:02:13.219290 run osmo-stp_10.42.42.5(pid=16615): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16615)] 14:02:13.347153 run osmo-stp_10.42.42.5(pid=16615): stdout: | (launched: 2022-12-10_14:02:12.051710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:13.474397 run osmo-stp_10.42.42.5(pid=16615): stderr: | [0;m[38;5;43m20221210140212220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140212220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140212221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140212221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140212221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140212222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140212222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:13.599677 run osmo-stp_10.42.42.5(pid=16615): stdout: | (launched: 2022-12-10_14:02:12.051710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:13.719205 run osmo-stp_10.42.42.5(pid=16615): stderr: | [0;m[38;5;43m20221210140212220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140212220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140212221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140212221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140212221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140212222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140212222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:13.862645 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16615): Process ended prematurely: osmo-stp_10.42.42.5(pid=16615) [trial-2375↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16615)] [trial-2375↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 14:02:13.870880 tst handover.py:18: Test FAILED (6.4 sec) 14:02:13.896770 run osmo-hlr_10.42.42.2(pid=16612): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16612)] 14:02:13.944109 run osmo-hlr_10.42.42.2(pid=16612): stdout: | (launched: 2022-12-10_14:02:11.140214) 14:02:13.993215 run osmo-hlr_10.42.42.2(pid=16612): stderr: | [0;m[1;31m20221210140211316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140211316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140211316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140211316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140211316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140211316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140211329 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140211338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140211338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140211338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:14.061597 run osmo-msc_10.42.42.6(pid=16618): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16618)] 14:02:14.108904 run osmo-msc_10.42.42.6(pid=16618): stdout: | (launched: 2022-12-10_14:02:12.994990) 14:02:14.157658 run osmo-msc_10.42.42.6(pid=16618): stderr: | [0;m[38;5;43m20221210140213264 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140213264 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f04b354dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140213264 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140213265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140213265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140213265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140213267 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140213267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140213267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140213267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:14.206732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16611): Terminating (SIGTERM) 14:02:14.245740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16614): Terminating (SIGTERM) 14:02:14.285058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16617): Terminating (SIGTERM) 14:02:14.324684 --- ParallelTerminationStrategy: PID 16611 died... 14:02:14.343616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16611): Terminated: ok {rc=0} 14:02:14.387179 --- ParallelTerminationStrategy: PID 16614 died... 14:02:14.405552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16614): Terminated: ok {rc=0} 14:02:14.448828 --- ParallelTerminationStrategy: PID 16617 died... 14:02:14.467721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16617): Terminated: ok {rc=0} 14:02:14.553496 bus /sierra_3: Setting Powered False 14:02:15.651764 bus /sierra_3: Setting Powered False 14:02:16.787050 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 14:02:18.052362 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:02:18.059004 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:02:18.097430 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:02:18.124099 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:02:18.176714 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:02:18.214300 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:02:18.241316 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:02:18.790300 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 14:02:18.795494 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:02:18.806591 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 14:02:18.840141 tst handover.py: using LAC 28904 14:02:18.965414 tst handover.py: using RAC 89 14:02:19.084521 tst handover.py: using CellId 28904 14:02:19.206551 tst handover.py: using BVCI 28905 14:02:19.316763 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 14:02:19.349354 tst handover.py: using LAC 28905 14:02:19.465355 tst handover.py: using RAC 90 14:02:19.580924 tst handover.py: using CellId 28905 14:02:19.696920 tst handover.py: using BVCI 28906 14:02:19.805209 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:02:19.815623 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:02:19.826107 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:02:19.836462 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:02:19.847003 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:02:19.857528 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 14:02:19.974842 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 14:02:20.089923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:20.528152 run create_hlr_db(pid=16623): Launched 14:02:20.650423 bus /sierra_2: Setting Powered False 14:02:21.710401 run create_hlr_db(pid=16623): Terminated: ok {rc=0} 14:02:22.119087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16625): Launched 14:02:22.439187 run osmo-hlr_10.42.42.2(pid=16626): Launched 14:02:22.562615 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:23.090380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16628): Launched 14:02:23.409656 run osmo-stp_10.42.42.5(pid=16629): Launched 14:02:23.532525 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:24.087661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16631): Launched 14:02:24.391485 run osmo-msc_10.42.42.6(pid=16632): Launched 14:02:24.559872 run osmo-stp_10.42.42.5(pid=16629): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16629)] 14:02:24.687590 run osmo-stp_10.42.42.5(pid=16629): stdout: | (launched: 2022-12-10_14:02:23.351698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:24.814511 run osmo-stp_10.42.42.5(pid=16629): stderr: | [0;m[38;5;43m20221210140223543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140223543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140223543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140223544 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140223544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140223544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140223545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:24.939476 run osmo-stp_10.42.42.5(pid=16629): stdout: | (launched: 2022-12-10_14:02:23.351698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:25.057995 run osmo-stp_10.42.42.5(pid=16629): stderr: | [0;m[38;5;43m20221210140223543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140223543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140223543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140223544 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140223544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140223544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140223545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:25.200022 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16629): Process ended prematurely: osmo-stp_10.42.42.5(pid=16629) [trial-2375↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16629)] [trial-2375↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 14:02:25.208354 tst handover.py:18: Test FAILED (6.4 sec) 14:02:25.233898 run osmo-hlr_10.42.42.2(pid=16626): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16626)] 14:02:25.280774 run osmo-hlr_10.42.42.2(pid=16626): stdout: | (launched: 2022-12-10_14:02:22.381462) 14:02:25.329389 run osmo-hlr_10.42.42.2(pid=16626): stderr: | [0;m[1;31m20221210140222579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140222579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140222579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140222579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140222579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140222580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140222592 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140222601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140222601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140222601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:25.397401 run osmo-msc_10.42.42.6(pid=16632): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16632)] 14:02:25.444587 run osmo-msc_10.42.42.6(pid=16632): stdout: | (launched: 2022-12-10_14:02:24.336604) 14:02:25.493109 run osmo-msc_10.42.42.6(pid=16632): stderr: | [0;m[38;5;43m20221210140224608 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140224608 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fecb9e19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140224608 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140224608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140224608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140224609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140224610 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140224611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140224611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140224611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:25.541722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16625): Terminating (SIGTERM) 14:02:25.580500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16628): Terminating (SIGTERM) 14:02:25.619260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16631): Terminating (SIGTERM) 14:02:25.658350 --- ParallelTerminationStrategy: PID 16625 died... 14:02:25.677131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16625): Terminated: ok {rc=0} 14:02:25.720305 --- ParallelTerminationStrategy: PID 16628 died... 14:02:25.738474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16628): Terminated: ok {rc=0} 14:02:25.781306 --- ParallelTerminationStrategy: PID 16631 died... 14:02:25.799316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16631): Terminated: ok {rc=0} 14:02:25.883566 bus /sierra_3: Setting Powered False 14:02:26.983543 bus /sierra_3: Setting Powered False 14:02:28.097288 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 14:02:29.331870 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:02:29.336670 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:02:29.384138 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:02:29.410030 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:02:29.461642 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:02:29.509982 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:02:29.535848 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:02:30.085794 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 14:02:30.090915 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:02:30.101547 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:02:30.133499 tst handover.py: using LAC 28906 14:02:30.260318 tst handover.py: using RAC 91 14:02:30.387224 tst handover.py: using CellId 28906 14:02:30.514293 tst handover.py: using BVCI 28907 14:02:30.633181 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:02:30.682228 tst handover.py: using LAC 28907 14:02:30.809786 tst handover.py: using RAC 92 14:02:30.982835 tst handover.py: using CellId 28907 14:02:31.117542 tst handover.py: using BVCI 28908 14:02:31.257585 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:02:31.269429 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:02:31.280890 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:02:31.292879 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:02:31.304820 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:02:31.316099 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:02:31.437578 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:02:31.554682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:32.016735 run create_hlr_db(pid=16638): Launched 14:02:32.175913 bus /sierra_2: Setting Powered False 14:02:33.236310 run create_hlr_db(pid=16638): Terminated: ok {rc=0} 14:02:33.628348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16640): Launched 14:02:33.927073 run osmo-hlr_10.42.42.2(pid=16641): Launched 14:02:34.040938 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:34.544792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16643): Launched 14:02:34.842902 run osmo-stp_10.42.42.5(pid=16644): Launched 14:02:34.956835 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:35.471893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16646): Launched 14:02:35.771128 run osmo-msc_10.42.42.6(pid=16647): Launched 14:02:35.938884 run osmo-stp_10.42.42.5(pid=16644): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16644)] 14:02:36.069664 run osmo-stp_10.42.42.5(pid=16644): stdout: | (launched: 2022-12-10_14:02:34.788195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:36.196313 run osmo-stp_10.42.42.5(pid=16644): stderr: | [0;m[38;5;43m20221210140234956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140234957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140234957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140234957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140234958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140234958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140234958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:36.321309 run osmo-stp_10.42.42.5(pid=16644): stdout: | (launched: 2022-12-10_14:02:34.788195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:36.440064 run osmo-stp_10.42.42.5(pid=16644): stderr: | [0;m[38;5;43m20221210140234956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140234957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140234957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140234957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140234958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140234958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140234958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:36.582465 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16644): Process ended prematurely: osmo-stp_10.42.42.5(pid=16644) [trial-2375↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16644)] [trial-2375↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 14:02:36.590468 tst handover.py:18: Test FAILED (6.5 sec) 14:02:36.616188 run osmo-hlr_10.42.42.2(pid=16641): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16641)] 14:02:36.663469 run osmo-hlr_10.42.42.2(pid=16641): stdout: | (launched: 2022-12-10_14:02:33.872427) 14:02:36.712367 run osmo-hlr_10.42.42.2(pid=16641): stderr: | [0;m[1;31m20221210140234050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140234050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140234050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140234050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140234050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140234050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140234062 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140234073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140234073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140234073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:36.780817 run osmo-msc_10.42.42.6(pid=16647): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16647)] 14:02:36.828286 run osmo-msc_10.42.42.6(pid=16647): stdout: | (launched: 2022-12-10_14:02:35.716528) 14:02:36.877109 run osmo-msc_10.42.42.6(pid=16647): stderr: | [0;m[38;5;43m20221210140235998 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140235998 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f67d9037c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140235998 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140235998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140235998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140235999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140236000 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140236001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140236001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140236001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:36.926672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16640): Terminating (SIGTERM) 14:02:36.965907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16643): Terminating (SIGTERM) 14:02:37.005105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16646): Terminating (SIGTERM) 14:02:37.044447 --- ParallelTerminationStrategy: PID 16640 died... 14:02:37.063310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16640): Terminated: ok {rc=0} 14:02:37.106730 --- ParallelTerminationStrategy: PID 16643 died... 14:02:37.125088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16643): Terminated: ok {rc=0} 14:02:37.168176 --- ParallelTerminationStrategy: PID 16646 died... 14:02:37.186554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16646): Terminated: ok {rc=0} 14:02:37.271282 bus /sierra_3: Setting Powered False 14:02:38.370448 bus /sierra_3: Setting Powered False 14:02:39.485559 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 14:02:40.734550 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:02:40.739752 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:02:40.786603 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:02:40.812558 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:02:40.862730 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:02:40.909921 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:02:40.935982 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:02:41.486928 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 14:02:41.491895 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:02:41.502619 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:02:41.535554 tst handover.py: using LAC 28908 14:02:41.653005 tst handover.py: using RAC 93 14:02:41.772647 tst handover.py: using CellId 28908 14:02:41.891349 tst handover.py: using BVCI 28909 14:02:42.000449 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:02:42.046142 tst handover.py: using LAC 28909 14:02:42.162527 tst handover.py: using RAC 94 14:02:42.278490 tst handover.py: using CellId 28909 14:02:42.394539 tst handover.py: using BVCI 28910 14:02:42.503828 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:02:42.514461 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:02:42.524894 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:02:42.535401 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:02:42.545930 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:02:42.556248 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:02:42.670153 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:02:42.786222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:43.224177 run create_hlr_db(pid=16653): Launched 14:02:43.346113 bus /sierra_2: Setting Powered False 14:02:44.406291 run create_hlr_db(pid=16653): Terminated: ok {rc=0} 14:02:44.815545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16655): Launched 14:02:45.136190 run osmo-hlr_10.42.42.2(pid=16656): Launched 14:02:45.258994 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:45.787741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16658): Launched 14:02:46.167031 run osmo-stp_10.42.42.5(pid=16659): Launched 14:02:46.289824 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:46.961826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16661): Launched 14:02:47.291664 run osmo-msc_10.42.42.6(pid=16662): Launched 14:02:47.497263 run osmo-stp_10.42.42.5(pid=16659): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16659)] 14:02:47.634384 run osmo-stp_10.42.42.5(pid=16659): stdout: | (launched: 2022-12-10_14:02:46.098277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:47.771477 run osmo-stp_10.42.42.5(pid=16659): stderr: | [0;m[38;5;43m20221210140246469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140246469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140246469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140246470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140246470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140246470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140246470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:47.907205 run osmo-stp_10.42.42.5(pid=16659): stdout: | (launched: 2022-12-10_14:02:46.098277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:48.035041 run osmo-stp_10.42.42.5(pid=16659): stderr: | [0;m[38;5;43m20221210140246469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140246469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140246469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140246470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140246470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140246470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140246470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:48.187724 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16659): Process ended prematurely: osmo-stp_10.42.42.5(pid=16659) [trial-2375↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16659)] [trial-2375↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 14:02:48.196705 tst handover.py:18: Test FAILED (6.7 sec) 14:02:48.224712 run osmo-hlr_10.42.42.2(pid=16656): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16656)] 14:02:48.275234 run osmo-hlr_10.42.42.2(pid=16656): stdout: | (launched: 2022-12-10_14:02:45.078409) 14:02:48.327234 run osmo-hlr_10.42.42.2(pid=16656): stderr: | [0;m[1;31m20221210140245275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140245275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140245275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140245276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140245276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140245276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140245295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140245305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140245305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140245305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:48.400022 run osmo-msc_10.42.42.6(pid=16662): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16662)] 14:02:48.450377 run osmo-msc_10.42.42.6(pid=16662): stdout: | (launched: 2022-12-10_14:02:47.231742) 14:02:48.502327 run osmo-msc_10.42.42.6(pid=16662): stderr: | [0;m[38;5;43m20221210140247576 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140247577 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f62d9affc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140247577 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140247577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140247577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140247577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140247579 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140247579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140247580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140247580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:48.554621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16655): Terminating (SIGTERM) 14:02:48.596593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16658): Terminating (SIGTERM) 14:02:48.638948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16661): Terminating (SIGTERM) 14:02:48.681056 --- ParallelTerminationStrategy: PID 16655 died... 14:02:48.700924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16655): Terminated: ok {rc=0} 14:02:48.747760 --- ParallelTerminationStrategy: PID 16658 died... 14:02:48.767390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16658): Terminated: ok {rc=0} 14:02:48.814001 --- ParallelTerminationStrategy: PID 16661 died... 14:02:48.833716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16661): Terminated: ok {rc=0} 14:02:48.921798 bus /sierra_3: Setting Powered False 14:02:50.019123 bus /sierra_3: Setting Powered False 14:02:51.134127 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:02:52.384899 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:02:52.390681 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:02:52.450194 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:02:52.477193 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:02:52.529690 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:02:52.591057 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:02:52.617799 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:02:53.168170 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:02:53.173539 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:02:53.184692 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:02:53.233326 tst handover.py: using LAC 28910 14:02:53.358421 tst handover.py: using RAC 95 14:02:53.484250 tst handover.py: using CellId 28910 14:02:53.612352 tst handover.py: using BVCI 28911 14:02:53.729612 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:02:53.774487 tst handover.py: using LAC 28911 14:02:53.902189 tst handover.py: using RAC 96 14:02:54.029753 tst handover.py: using CellId 28911 14:02:54.156135 tst handover.py: using BVCI 28912 14:02:54.274983 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:02:54.286293 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:02:54.297491 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:02:54.309036 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:02:54.320535 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:02:54.331816 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:02:54.449975 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:02:54.567908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:55.035011 run create_hlr_db(pid=16667): Launched 14:02:55.156228 bus /sierra_2: Setting Powered False 14:02:56.220236 run create_hlr_db(pid=16667): Terminated: ok {rc=0} 14:02:56.636758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16669): Launched 14:02:56.958072 run osmo-hlr_10.42.42.2(pid=16670): Launched 14:02:57.080757 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:57.605648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16672): Launched 14:02:57.926509 run osmo-stp_10.42.42.5(pid=16673): Launched 14:02:58.049054 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:58.597907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16675): Launched 14:02:58.917552 run osmo-msc_10.42.42.6(pid=16676): Launched 14:02:59.095980 run osmo-stp_10.42.42.5(pid=16673): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16673)] 14:02:59.231998 run osmo-stp_10.42.42.5(pid=16673): stdout: | (launched: 2022-12-10_14:02:57.868143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:59.368132 run osmo-stp_10.42.42.5(pid=16673): stderr: | [0;m[38;5;43m20221210140258060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140258061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140258061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140258061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140258062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140258062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140258062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:59.503408 run osmo-stp_10.42.42.5(pid=16673): stdout: | (launched: 2022-12-10_14:02:57.868143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:59.630629 run osmo-stp_10.42.42.5(pid=16673): stderr: | [0;m[38;5;43m20221210140258060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140258061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140258061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140258061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140258062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140258062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140258062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:59.783052 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16673): Process ended prematurely: osmo-stp_10.42.42.5(pid=16673) [trial-2375↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16673)] [trial-2375↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 14:02:59.791756 tst handover.py:18: Test FAILED (6.6 sec) 14:02:59.819531 run osmo-hlr_10.42.42.2(pid=16670): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16670)] 14:02:59.869474 run osmo-hlr_10.42.42.2(pid=16670): stdout: | (launched: 2022-12-10_14:02:56.900103) 14:02:59.920790 run osmo-hlr_10.42.42.2(pid=16670): stderr: | [0;m[1;31m20221210140257099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140257099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140257099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140257099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140257099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140257099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140257109 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140257118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140257118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140257118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:59.992303 run osmo-msc_10.42.42.6(pid=16676): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16676)] 14:03:00.041492 run osmo-msc_10.42.42.6(pid=16676): stdout: | (launched: 2022-12-10_14:02:58.859394) 14:03:00.093258 run osmo-msc_10.42.42.6(pid=16676): stderr: | [0;m[38;5;43m20221210140259182 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140259182 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f795f134c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140259182 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140259182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140259183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140259183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140259184 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140259185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140259185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140259185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:00.144856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16669): Terminating (SIGTERM) 14:03:00.186413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16672): Terminating (SIGTERM) 14:03:00.228008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16675): Terminating (SIGTERM) 14:03:00.270055 --- ParallelTerminationStrategy: PID 16669 died... 14:03:00.289797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16669): Terminated: ok {rc=0} 14:03:00.336360 --- ParallelTerminationStrategy: PID 16672 died... 14:03:00.355841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16672): Terminated: ok {rc=0} 14:03:00.402222 --- ParallelTerminationStrategy: PID 16675 died... 14:03:00.421719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16675): Terminated: ok {rc=0} 14:03:00.509405 bus /sierra_3: Setting Powered False 14:03:01.622726 bus /sierra_3: Setting Powered False 14:03:02.738446 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:03:04.002858 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:03:04.008531 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:03:04.073098 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:03:04.100014 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:03:04.154705 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:03:04.218752 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:03:04.245525 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:03:04.794226 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:03:04.799842 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:03:04.811350 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:03:04.861046 tst handover.py: using LAC 28912 14:03:04.986268 tst handover.py: using RAC 97 14:03:05.112681 tst handover.py: using CellId 28912 14:03:05.240120 tst handover.py: using BVCI 28913 14:03:05.359069 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:03:05.408422 tst handover.py: using LAC 28913 14:03:05.535400 tst handover.py: using RAC 98 14:03:05.666778 tst handover.py: using CellId 28913 14:03:05.790382 tst handover.py: using BVCI 28914 14:03:05.900290 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:03:05.911263 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:03:05.922055 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:03:05.932899 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:03:05.943703 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:03:05.954433 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:03:06.072205 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:03:06.193921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:06.662486 run create_hlr_db(pid=16682): Launched 14:03:06.785016 bus /sierra_2: Setting Powered False 14:03:07.848215 run create_hlr_db(pid=16682): Terminated: ok {rc=0} 14:03:08.263899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16684): Launched 14:03:08.583554 run osmo-hlr_10.42.42.2(pid=16685): Launched 14:03:08.706893 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:09.232433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16687): Launched 14:03:09.551705 run osmo-stp_10.42.42.5(pid=16688): Launched 14:03:09.674193 run osmo-msc_10.42.42.6: Starting osmo-msc 14:03:10.222359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16690): Launched 14:03:10.542001 run osmo-msc_10.42.42.6(pid=16691): Launched 14:03:10.720769 run osmo-stp_10.42.42.5(pid=16688): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16688)] 14:03:10.856271 run osmo-stp_10.42.42.5(pid=16688): stdout: | (launched: 2022-12-10_14:03:09.493771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:10.991907 run osmo-stp_10.42.42.5(pid=16688): stderr: | [0;m[38;5;43m20221210140309687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140309688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140309688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140309688 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140309689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140309689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140309689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:11.126954 run osmo-stp_10.42.42.5(pid=16688): stdout: | (launched: 2022-12-10_14:03:09.493771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:11.253616 run osmo-stp_10.42.42.5(pid=16688): stderr: | [0;m[38;5;43m20221210140309687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140309688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140309688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140309688 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140309689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140309689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140309689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:11.404935 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16688): Process ended prematurely: osmo-stp_10.42.42.5(pid=16688) [trial-2375↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16688)] [trial-2375↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 14:03:11.413765 tst handover.py:18: Test FAILED (6.6 sec) 14:03:11.441415 run osmo-hlr_10.42.42.2(pid=16685): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16685)] 14:03:11.491513 run osmo-hlr_10.42.42.2(pid=16685): stdout: | (launched: 2022-12-10_14:03:08.525281) 14:03:11.543244 run osmo-hlr_10.42.42.2(pid=16685): stderr: | [0;m[1;31m20221210140308721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140308722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140308722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140308722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140308722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140308722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140308735 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140308743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140308743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140308743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:11.615707 run osmo-msc_10.42.42.6(pid=16691): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16691)] 14:03:11.666364 run osmo-msc_10.42.42.6(pid=16691): stdout: | (launched: 2022-12-10_14:03:10.484064) 14:03:11.718432 run osmo-msc_10.42.42.6(pid=16691): stderr: | [0;m[38;5;43m20221210140310805 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140310805 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4cd2696c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140310805 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140310806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140310806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140310806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140310807 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140310808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140310809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140310809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:11.770749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16684): Terminating (SIGTERM) 14:03:11.812743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16687): Terminating (SIGTERM) 14:03:11.855102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16690): Terminating (SIGTERM) 14:03:11.897731 --- ParallelTerminationStrategy: PID 16684 died... 14:03:11.917630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16684): Terminated: ok {rc=0} 14:03:11.964262 --- ParallelTerminationStrategy: PID 16687 died... 14:03:11.983779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16687): Terminated: ok {rc=0} 14:03:12.029957 --- ParallelTerminationStrategy: PID 16690 died... 14:03:12.049475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16690): Terminated: ok {rc=0} 14:03:12.137663 bus /sierra_3: Setting Powered False 14:03:13.235750 bus /sierra_3: Setting Powered False 14:03:14.350871 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 14:03:15.621438 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:03:15.626935 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:03:15.678983 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:03:15.706241 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:03:15.758583 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:03:15.809703 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:03:15.846413 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:03:16.400206 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 14:03:16.407305 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:03:16.420381 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 14:03:16.473739 tst handover.py: using LAC 28914 14:03:16.607366 tst handover.py: using RAC 99 14:03:16.764287 tst handover.py: using CellId 28914 14:03:16.894426 tst handover.py: using BVCI 28915 14:03:17.014178 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 14:03:17.050459 tst handover.py: using LAC 28915 14:03:17.169420 tst handover.py: using RAC 100 14:03:17.286644 tst handover.py: using CellId 28915 14:03:17.402659 tst handover.py: using BVCI 28916 14:03:17.512476 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:03:17.523147 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:03:17.533811 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:03:17.544364 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:03:17.554914 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:03:17.565365 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 14:03:17.682674 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 14:03:17.802308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:18.268897 run create_hlr_db(pid=16696): Launched 14:03:18.392373 bus /sierra_2: Setting Powered False 14:03:19.455708 run create_hlr_db(pid=16696): Terminated: ok {rc=0} 14:03:19.872703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16698): Launched 14:03:20.191977 run osmo-hlr_10.42.42.2(pid=16699): Launched 14:03:20.315126 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:20.839908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16701): Launched 14:03:21.159533 run osmo-stp_10.42.42.5(pid=16702): Launched 14:03:21.283045 run osmo-msc_10.42.42.6: Starting osmo-msc 14:03:21.835557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16704): Launched 14:03:22.155654 run osmo-msc_10.42.42.6(pid=16705): Launched 14:03:22.334750 run osmo-stp_10.42.42.5(pid=16702): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16702)] 14:03:22.471507 run osmo-stp_10.42.42.5(pid=16702): stdout: | (launched: 2022-12-10_14:03:21.101276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:22.607783 run osmo-stp_10.42.42.5(pid=16702): stderr: | [0;m[38;5;43m20221210140321293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140321293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140321293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140321293 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140321294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140321294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140321294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:22.743826 run osmo-stp_10.42.42.5(pid=16702): stdout: | (launched: 2022-12-10_14:03:21.101276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:22.870987 run osmo-stp_10.42.42.5(pid=16702): stderr: | [0;m[38;5;43m20221210140321293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140321293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140321293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140321293 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140321294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140321294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140321294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:23.023061 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16702): Process ended prematurely: osmo-stp_10.42.42.5(pid=16702) [trial-2375↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16702)] [trial-2375↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 14:03:23.031810 tst handover.py:18: Test FAILED (6.6 sec) 14:03:23.059693 run osmo-hlr_10.42.42.2(pid=16699): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16699)] 14:03:23.109986 run osmo-hlr_10.42.42.2(pid=16699): stdout: | (launched: 2022-12-10_14:03:20.134150) 14:03:23.161882 run osmo-hlr_10.42.42.2(pid=16699): stderr: | [0;m[1;31m20221210140320332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140320332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140320332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140320332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140320332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140320332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140320344 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140320352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140320353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140320353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:23.234602 run osmo-msc_10.42.42.6(pid=16705): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16705)] 14:03:23.284691 run osmo-msc_10.42.42.6(pid=16705): stdout: | (launched: 2022-12-10_14:03:22.097643) 14:03:23.336205 run osmo-msc_10.42.42.6(pid=16705): stderr: | [0;m[38;5;43m20221210140322418 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140322418 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fede7ac6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140322418 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140322418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140322418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140322419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140322420 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140322421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140322421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140322421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:23.388102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16698): Terminating (SIGTERM) 14:03:23.429808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16701): Terminating (SIGTERM) 14:03:23.471584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16704): Terminating (SIGTERM) 14:03:23.513826 --- ParallelTerminationStrategy: PID 16698 died... 14:03:23.533591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16698): Terminated: ok {rc=0} 14:03:23.579634 --- ParallelTerminationStrategy: PID 16701 died... 14:03:23.598907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16701): Terminated: ok {rc=0} 14:03:23.644724 --- ParallelTerminationStrategy: PID 16704 died... 14:03:23.664482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16704): Terminated: ok {rc=0} 14:03:23.752644 bus /sierra_3: Setting Powered False 14:03:24.851093 bus /sierra_3: Setting Powered False 14:03:25.966211 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 14:03:27.224830 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:03:27.230635 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:03:27.291316 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:03:27.317726 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:03:27.366484 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:03:27.428819 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:03:27.455209 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:03:28.007305 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 14:03:28.012235 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:03:28.022924 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:03:28.069287 tst handover.py: using LAC 28916 14:03:28.187466 tst handover.py: using RAC 101 14:03:28.303233 tst handover.py: using CellId 28916 14:03:28.419229 tst handover.py: using BVCI 28917 14:03:28.529463 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:03:28.575707 tst handover.py: using LAC 28917 14:03:28.691627 tst handover.py: using RAC 102 14:03:28.807319 tst handover.py: using CellId 28917 14:03:28.928054 tst handover.py: using BVCI 28918 14:03:29.038208 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:03:29.048802 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:03:29.059329 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:03:29.069893 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:03:29.080349 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:03:29.090906 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:03:29.207785 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:03:29.324362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:29.792573 run create_hlr_db(pid=16710): Launched 14:03:29.915301 bus /sierra_2: Setting Powered False 14:03:30.978359 run create_hlr_db(pid=16710): Terminated: ok {rc=0} 14:03:31.418698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16712): Launched 14:03:31.778470 run osmo-hlr_10.42.42.2(pid=16713): Launched 14:03:31.918070 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:32.545929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16715): Launched 14:03:32.845354 run osmo-stp_10.42.42.5(pid=16716): Launched 14:03:32.959512 run osmo-msc_10.42.42.6: Starting osmo-msc 14:03:33.478488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16718): Launched 14:03:33.778038 run osmo-msc_10.42.42.6(pid=16719): Launched 14:03:33.945914 run osmo-stp_10.42.42.5(pid=16716): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16716)] 14:03:34.073617 run osmo-stp_10.42.42.5(pid=16716): stdout: | (launched: 2022-12-10_14:03:32.790366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:34.200728 run osmo-stp_10.42.42.5(pid=16716): stderr: | [0;m[38;5;43m20221210140332957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140332958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140332958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140332958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140332960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140332961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140332961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:34.325768 run osmo-stp_10.42.42.5(pid=16716): stdout: | (launched: 2022-12-10_14:03:32.790366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:34.444638 run osmo-stp_10.42.42.5(pid=16716): stderr: | [0;m[38;5;43m20221210140332957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140332958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140332958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140332958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140332960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140332961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140332961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:34.587957 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16716): Process ended prematurely: osmo-stp_10.42.42.5(pid=16716) [trial-2375↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16716)] [trial-2375↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 14:03:34.596271 tst handover.py:18: Test FAILED (6.6 sec) 14:03:34.622108 run osmo-hlr_10.42.42.2(pid=16713): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16713)] 14:03:34.669645 run osmo-hlr_10.42.42.2(pid=16713): stdout: | (launched: 2022-12-10_14:03:31.713474) 14:03:34.718517 run osmo-hlr_10.42.42.2(pid=16713): stderr: | [0;m[1;31m20221210140332050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140332050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140332050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140332050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140332050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140332050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140332075 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140332092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140332092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140332092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:34.786623 run osmo-msc_10.42.42.6(pid=16719): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16719)] 14:03:34.833622 run osmo-msc_10.42.42.6(pid=16719): stdout: | (launched: 2022-12-10_14:03:33.723119) 14:03:34.882171 run osmo-msc_10.42.42.6(pid=16719): stderr: | [0;m[38;5;43m20221210140333992 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140333992 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f99a6009c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140333992 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140333993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140333993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140333993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140333995 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140333995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140333995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140333995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:34.931219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16712): Terminating (SIGTERM) 14:03:34.970290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16715): Terminating (SIGTERM) 14:03:35.009555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16718): Terminating (SIGTERM) 14:03:35.049311 --- ParallelTerminationStrategy: PID 16712 died... 14:03:35.068079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16712): Terminated: ok {rc=0} 14:03:35.111402 --- ParallelTerminationStrategy: PID 16715 died... 14:03:35.129851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16715): Terminated: ok {rc=0} 14:03:35.173029 --- ParallelTerminationStrategy: PID 16718 died... 14:03:35.191506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16718): Terminated: ok {rc=0} 14:03:35.277433 bus /sierra_3: Setting Powered False 14:03:36.376876 bus /sierra_3: Setting Powered False 14:03:37.490988 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 14:03:38.765323 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:03:38.771100 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:03:38.834080 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:03:38.861237 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:03:38.913377 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:03:38.977181 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:03:39.003872 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:03:39.553721 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 14:03:39.559051 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:03:39.570229 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:03:39.618661 tst handover.py: using LAC 28918 14:03:39.746641 tst handover.py: using RAC 103 14:03:39.874157 tst handover.py: using CellId 28918 14:03:40.001337 tst handover.py: using BVCI 28919 14:03:40.119126 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:03:40.166706 tst handover.py: using LAC 28919 14:03:40.293971 tst handover.py: using RAC 104 14:03:40.422638 tst handover.py: using CellId 28919 14:03:40.548025 tst handover.py: using BVCI 28920 14:03:40.665108 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:03:40.676260 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:03:40.687226 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:03:40.698499 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:03:40.709800 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:03:40.721039 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:03:40.836472 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:03:40.955436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:41.423464 run create_hlr_db(pid=16724): Launched 14:03:41.545656 bus /sierra_2: Setting Powered False 14:03:42.610071 run create_hlr_db(pid=16724): Terminated: ok {rc=0} 14:03:43.027373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16726): Launched 14:03:43.347203 run osmo-hlr_10.42.42.2(pid=16727): Launched 14:03:43.470222 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:43.997327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16729): Launched 14:03:44.316361 run osmo-stp_10.42.42.5(pid=16730): Launched 14:03:44.438580 run osmo-msc_10.42.42.6: Starting osmo-msc 14:03:44.987980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16732): Launched 14:03:45.307940 run osmo-msc_10.42.42.6(pid=16733): Launched 14:03:45.487523 run osmo-stp_10.42.42.5(pid=16730): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16730)] 14:03:45.623852 run osmo-stp_10.42.42.5(pid=16730): stdout: | (launched: 2022-12-10_14:03:44.258437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:45.760742 run osmo-stp_10.42.42.5(pid=16730): stderr: | [0;m[38;5;43m20221210140344451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140344451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140344452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140344452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140344452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140344452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140344453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:45.924015 run osmo-stp_10.42.42.5(pid=16730): stdout: | (launched: 2022-12-10_14:03:44.258437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:46.053699 run osmo-stp_10.42.42.5(pid=16730): stderr: | [0;m[38;5;43m20221210140344451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140344451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140344452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140344452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140344452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140344452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140344453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:46.209564 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16730): Process ended prematurely: osmo-stp_10.42.42.5(pid=16730) [trial-2375↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16730)] [trial-2375↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 14:03:46.219104 tst handover.py:18: Test FAILED (6.7 sec) 14:03:46.249529 run osmo-hlr_10.42.42.2(pid=16727): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16727)] 14:03:46.301942 run osmo-hlr_10.42.42.2(pid=16727): stdout: | (launched: 2022-12-10_14:03:43.288654) 14:03:46.355634 run osmo-hlr_10.42.42.2(pid=16727): stderr: | [0;m[1;31m20221210140343487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140343487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140343487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140343487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140343487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140343487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140343499 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140343507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140343507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140343507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:46.430429 run osmo-msc_10.42.42.6(pid=16733): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16733)] 14:03:46.482518 run osmo-msc_10.42.42.6(pid=16733): stdout: | (launched: 2022-12-10_14:03:45.249804) 14:03:46.536121 run osmo-msc_10.42.42.6(pid=16733): stderr: | [0;m[38;5;43m20221210140345571 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140345571 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fef881bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140345571 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140345571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140345572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140345572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140345574 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140345574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140345574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140345574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:46.590438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16726): Terminating (SIGTERM) 14:03:46.634151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16729): Terminating (SIGTERM) 14:03:46.678628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16732): Terminating (SIGTERM) 14:03:46.723761 --- ParallelTerminationStrategy: PID 16726 died... 14:03:46.744399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16726): Terminated: ok {rc=0} 14:03:46.793335 --- ParallelTerminationStrategy: PID 16729 died... 14:03:46.813494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16729): Terminated: ok {rc=0} 14:03:46.862807 --- ParallelTerminationStrategy: PID 16732 died... 14:03:46.883101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16732): Terminated: ok {rc=0} 14:03:46.974505 bus /sierra_3: Setting Powered False 14:03:48.074392 bus /sierra_3: Setting Powered False 14:03:49.190506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:03:50.456806 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:03:50.461972 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:03:50.520083 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:03:50.546261 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:03:50.597075 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:03:50.656539 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:03:50.682994 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:03:51.234995 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:03:51.240424 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:03:51.251760 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:03:51.296737 tst handover.py: using LAC 28920 14:03:51.415664 tst handover.py: using RAC 105 14:03:51.536171 tst handover.py: using CellId 28920 14:03:51.661414 tst handover.py: using BVCI 28921 14:03:51.770018 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:03:51.818549 tst handover.py: using LAC 28921 14:03:51.938336 tst handover.py: using RAC 106 14:03:52.058335 tst handover.py: using CellId 28921 14:03:52.178356 tst handover.py: using BVCI 28922 14:03:52.288480 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:03:52.299786 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:03:52.310861 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:03:52.321999 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:03:52.332827 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:03:52.343906 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:03:52.462326 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:03:52.578003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:53.018127 run create_hlr_db(pid=16738): Launched 14:03:53.139427 bus /sierra_2: Setting Powered False 14:03:54.200070 run create_hlr_db(pid=16738): Terminated: ok {rc=0} 14:03:54.608524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16740): Launched 14:03:54.929168 run osmo-hlr_10.42.42.2(pid=16742): Launched 14:03:55.052487 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:55.579126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16744): Launched 14:03:55.899931 run osmo-stp_10.42.42.5(pid=16745): Launched 14:03:56.022865 run osmo-msc_10.42.42.6: Starting osmo-msc 14:03:56.576018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16747): Launched 14:03:56.896919 run osmo-msc_10.42.42.6(pid=16748): Launched 14:03:57.076477 run osmo-stp_10.42.42.5(pid=16745): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16745)] 14:03:57.213086 run osmo-stp_10.42.42.5(pid=16745): stdout: | (launched: 2022-12-10_14:03:55.841029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:57.349648 run osmo-stp_10.42.42.5(pid=16745): stderr: | [0;m[38;5;43m20221210140356035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140356036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140356036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140356036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140356037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140356037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140356037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:57.485199 run osmo-stp_10.42.42.5(pid=16745): stdout: | (launched: 2022-12-10_14:03:55.841029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:57.612404 run osmo-stp_10.42.42.5(pid=16745): stderr: | [0;m[38;5;43m20221210140356035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140356036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140356036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140356036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140356037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140356037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140356037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:57.765597 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16745): Process ended prematurely: osmo-stp_10.42.42.5(pid=16745) [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16745)] [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 14:03:57.774380 tst handover.py:18: Test FAILED (6.5 sec) 14:03:57.802392 run osmo-hlr_10.42.42.2(pid=16742): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16742)] 14:03:57.852364 run osmo-hlr_10.42.42.2(pid=16742): stdout: | (launched: 2022-12-10_14:03:54.871248) 14:03:57.904068 run osmo-hlr_10.42.42.2(pid=16742): stderr: | [0;m[1;31m20221210140355071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140355071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140355071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140355071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140355071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140355071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140355083 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140355092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140355092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140355092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:57.975882 run osmo-msc_10.42.42.6(pid=16748): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16748)] 14:03:58.025690 run osmo-msc_10.42.42.6(pid=16748): stdout: | (launched: 2022-12-10_14:03:56.838756) 14:03:58.077349 run osmo-msc_10.42.42.6(pid=16748): stderr: | [0;m[38;5;43m20221210140357159 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140357159 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff52c4a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140357159 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140357159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140357159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140357160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140357161 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140357162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140357162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140357162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:58.129743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16740): Terminating (SIGTERM) 14:03:58.171298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16744): Terminating (SIGTERM) 14:03:58.212921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16747): Terminating (SIGTERM) 14:03:58.255925 --- ParallelTerminationStrategy: PID 16740 died... 14:03:58.276408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16740): Terminated: ok {rc=0} 14:03:58.332475 --- ParallelTerminationStrategy: PID 16744 died... 14:03:58.354056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16744): Terminated: ok {rc=0} 14:03:58.400338 --- ParallelTerminationStrategy: PID 16747 died... 14:03:58.419961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16747): Terminated: ok {rc=0} 14:03:58.508642 bus /sierra_3: Setting Powered False 14:03:59.604881 bus /sierra_3: Setting Powered False 14:04:00.719204 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 14:04:02.022603 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:02.028439 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:04:02.084934 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:04:02.118450 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:04:02.178676 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:04:02.237914 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:04:02.264690 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:04:02.800935 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 14:04:02.806117 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:02.816872 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 14:04:02.859479 tst handover.py: using LAC 28922 14:04:02.976889 tst handover.py: using RAC 107 14:04:03.094104 tst handover.py: using CellId 28922 14:04:03.213153 tst handover.py: using BVCI 28923 14:04:03.321639 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 14:04:03.354660 tst handover.py: using LAC 28923 14:04:03.470883 tst handover.py: using RAC 108 14:04:03.586974 tst handover.py: using CellId 28923 14:04:03.703527 tst handover.py: using BVCI 28924 14:04:03.812357 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:03.823331 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:03.833975 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:03.844578 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:03.855311 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:03.865980 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 14:04:03.984015 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 14:04:04.102144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:04.569815 run create_hlr_db(pid=16758): Launched 14:04:04.694005 bus /sierra_2: Setting Powered False 14:04:05.757969 run create_hlr_db(pid=16758): Terminated: ok {rc=0} 14:04:06.160736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16760): Launched 14:04:06.461268 run osmo-hlr_10.42.42.2(pid=16761): Launched 14:04:06.576289 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:07.065469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16763): Launched 14:04:07.365664 run osmo-stp_10.42.42.5(pid=16764): Launched 14:04:07.480197 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:07.997231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16766): Launched 14:04:08.295083 run osmo-msc_10.42.42.6(pid=16767): Launched 14:04:08.462580 run osmo-stp_10.42.42.5(pid=16764): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16764)] 14:04:08.589886 run osmo-stp_10.42.42.5(pid=16764): stdout: | (launched: 2022-12-10_14:04:07.310479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:08.715851 run osmo-stp_10.42.42.5(pid=16764): stderr: | [0;m[38;5;43m20221210140407479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140407479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140407479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140407480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140407482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140407482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140407482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:08.840942 run osmo-stp_10.42.42.5(pid=16764): stdout: | (launched: 2022-12-10_14:04:07.310479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:08.959388 run osmo-stp_10.42.42.5(pid=16764): stderr: | [0;m[38;5;43m20221210140407479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140407479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140407479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140407480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140407482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140407482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140407482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:09.101230 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16764): Process ended prematurely: osmo-stp_10.42.42.5(pid=16764) [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16764)] [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 14:04:09.109229 tst handover.py:18: Test FAILED (6.3 sec) 14:04:09.134766 run osmo-hlr_10.42.42.2(pid=16761): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16761)] 14:04:09.181777 run osmo-hlr_10.42.42.2(pid=16761): stdout: | (launched: 2022-12-10_14:04:06.406430) 14:04:09.230469 run osmo-hlr_10.42.42.2(pid=16761): stderr: | [0;m[1;31m20221210140406582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140406582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140406582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140406582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140406582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140406582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140406627 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140406636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140406636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140406636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:09.298395 run osmo-msc_10.42.42.6(pid=16767): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16767)] 14:04:09.345411 run osmo-msc_10.42.42.6(pid=16767): stdout: | (launched: 2022-12-10_14:04:08.240474) 14:04:09.394094 run osmo-msc_10.42.42.6(pid=16767): stderr: | [0;m[38;5;43m20221210140408512 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140408513 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5fbf9a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140408513 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140408513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140408513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140408514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140408515 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140408516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140408516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140408516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:09.443049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16760): Terminating (SIGTERM) 14:04:09.481892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16763): Terminating (SIGTERM) 14:04:09.520861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16766): Terminating (SIGTERM) 14:04:09.560379 --- ParallelTerminationStrategy: PID 16760 died... 14:04:09.579160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16760): Terminated: ok {rc=0} 14:04:09.622308 --- ParallelTerminationStrategy: PID 16763 died... 14:04:09.640692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16763): Terminated: ok {rc=0} 14:04:09.684089 --- ParallelTerminationStrategy: PID 16766 died... 14:04:09.702382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16766): Terminated: ok {rc=0} 14:04:09.784799 bus /sierra_3: Setting Powered False 14:04:10.881073 bus /sierra_3: Setting Powered False 14:04:11.996866 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 14:04:13.244137 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:13.249533 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:04:13.307004 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:04:13.333057 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:04:13.410640 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:04:13.468592 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:04:13.494865 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:04:14.025041 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 14:04:14.031816 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:14.042925 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:04:14.085893 tst handover.py: using LAC 28924 14:04:14.205363 tst handover.py: using RAC 109 14:04:14.322978 tst handover.py: using CellId 28924 14:04:14.441044 tst handover.py: using BVCI 28925 14:04:14.549336 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:04:14.597086 tst handover.py: using LAC 28925 14:04:14.715935 tst handover.py: using RAC 110 14:04:14.835198 tst handover.py: using CellId 28925 14:04:14.954681 tst handover.py: using BVCI 28926 14:04:15.064744 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:15.075686 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:15.086490 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:15.097399 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:15.108174 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:15.118958 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:04:15.236383 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:04:15.351319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:15.790314 run create_hlr_db(pid=16772): Launched 14:04:15.953448 bus /sierra_2: Setting Powered False 14:04:17.014391 run create_hlr_db(pid=16772): Terminated: ok {rc=0} 14:04:17.413718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16774): Launched 14:04:17.714028 run osmo-hlr_10.42.42.2(pid=16775): Launched 14:04:17.828158 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:18.316938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16777): Launched 14:04:18.615958 run osmo-stp_10.42.42.5(pid=16778): Launched 14:04:18.730270 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:19.246484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16780): Launched 14:04:19.545155 run osmo-msc_10.42.42.6(pid=16781): Launched 14:04:19.713394 run osmo-stp_10.42.42.5(pid=16778): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16778)] 14:04:19.841198 run osmo-stp_10.42.42.5(pid=16778): stdout: | (launched: 2022-12-10_14:04:18.560863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:19.967843 run osmo-stp_10.42.42.5(pid=16778): stderr: | [0;m[38;5;43m20221210140418732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140418732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140418732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140418733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140418733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140418734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140418734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:20.092471 run osmo-stp_10.42.42.5(pid=16778): stdout: | (launched: 2022-12-10_14:04:18.560863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:20.211110 run osmo-stp_10.42.42.5(pid=16778): stderr: | [0;m[38;5;43m20221210140418732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140418732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140418732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140418733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140418733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140418734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140418734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:20.352708 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16778): Process ended prematurely: osmo-stp_10.42.42.5(pid=16778) [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16778)] [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 14:04:20.360893 tst handover.py:18: Test FAILED (6.3 sec) 14:04:20.386637 run osmo-hlr_10.42.42.2(pid=16775): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16775)] 14:04:20.433560 run osmo-hlr_10.42.42.2(pid=16775): stdout: | (launched: 2022-12-10_14:04:17.659103) 14:04:20.481944 run osmo-hlr_10.42.42.2(pid=16775): stderr: | [0;m[1;31m20221210140417835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140417835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140417835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140417835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140417835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140417836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140417848 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140417856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140417857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140417857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:20.549977 run osmo-msc_10.42.42.6(pid=16781): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16781)] 14:04:20.596583 run osmo-msc_10.42.42.6(pid=16781): stdout: | (launched: 2022-12-10_14:04:19.489953) 14:04:20.644732 run osmo-msc_10.42.42.6(pid=16781): stderr: | [0;m[38;5;43m20221210140419760 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140419760 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbcd977fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140419761 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140419761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140419761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140419761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140419764 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140419764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140419764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140419764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:20.693432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16774): Terminating (SIGTERM) 14:04:20.732117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16777): Terminating (SIGTERM) 14:04:20.771012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16780): Terminating (SIGTERM) 14:04:20.810402 --- ParallelTerminationStrategy: PID 16774 died... 14:04:20.829220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16774): Terminated: ok {rc=0} 14:04:20.872719 --- ParallelTerminationStrategy: PID 16777 died... 14:04:20.890881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16777): Terminated: ok {rc=0} 14:04:20.933802 --- ParallelTerminationStrategy: PID 16780 died... 14:04:20.952061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16780): Terminated: ok {rc=0} 14:04:21.037710 bus /sierra_3: Setting Powered False 14:04:22.138114 bus /sierra_3: Setting Powered False 14:04:23.253174 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 14:04:24.517941 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:24.523196 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:04:24.579759 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:04:24.605818 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:04:24.657237 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:04:24.714812 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:04:24.741021 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:04:25.291662 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 14:04:25.296567 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:25.307509 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:04:25.353845 tst handover.py: using LAC 28926 14:04:25.481207 tst handover.py: using RAC 111 14:04:25.605159 tst handover.py: using CellId 28926 14:04:25.729451 tst handover.py: using BVCI 28927 14:04:25.838506 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:04:25.884396 tst handover.py: using LAC 28927 14:04:26.010393 tst handover.py: using RAC 112 14:04:26.136180 tst handover.py: using CellId 28927 14:04:26.259989 tst handover.py: using BVCI 28928 14:04:26.376469 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:26.388077 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:26.399770 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:26.411518 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:26.423155 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:26.434677 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:04:26.550117 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:04:26.669197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:27.137201 run create_hlr_db(pid=16786): Launched 14:04:27.259461 bus /sierra_2: Setting Powered False 14:04:28.322373 run create_hlr_db(pid=16786): Terminated: ok {rc=0} 14:04:28.725244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16788): Launched 14:04:29.026608 run osmo-hlr_10.42.42.2(pid=16789): Launched 14:04:29.141643 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:29.639928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16791): Launched 14:04:29.939470 run osmo-stp_10.42.42.5(pid=16792): Launched 14:04:30.054152 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:30.569671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16794): Launched 14:04:30.870140 run osmo-msc_10.42.42.6(pid=16795): Launched 14:04:31.277273 run osmo-stp_10.42.42.5(pid=16792): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16792)] 14:04:31.578572 run osmo-stp_10.42.42.5(pid=16792): stdout: | (launched: 2022-12-10_14:04:29.884585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:31.707573 run osmo-stp_10.42.42.5(pid=16792): stderr: | [0;m[38;5;43m20221210140430053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140430053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140430053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140430054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140430054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140430054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140430054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:31.834966 run osmo-stp_10.42.42.5(pid=16792): stdout: | (launched: 2022-12-10_14:04:29.884585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:31.956399 run osmo-stp_10.42.42.5(pid=16792): stderr: | [0;m[38;5;43m20221210140430053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140430053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140430053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140430054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140430054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140430054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140430054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:32.101626 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16792): Process ended prematurely: osmo-stp_10.42.42.5(pid=16792) [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16792)] [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 14:04:32.110408 tst handover.py:18: Test FAILED (6.8 sec) 14:04:32.137712 run osmo-hlr_10.42.42.2(pid=16789): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16789)] 14:04:32.186376 run osmo-hlr_10.42.42.2(pid=16789): stdout: | (launched: 2022-12-10_14:04:28.971257) 14:04:32.236178 run osmo-hlr_10.42.42.2(pid=16789): stderr: | [0;m[1;31m20221210140429146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140429146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140429146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140429146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140429146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140429146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140429159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140429167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140429168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140429168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:32.305380 run osmo-msc_10.42.42.6(pid=16795): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16795)] 14:04:32.353703 run osmo-msc_10.42.42.6(pid=16795): stdout: | (launched: 2022-12-10_14:04:30.814617) 14:04:32.403470 run osmo-msc_10.42.42.6(pid=16795): stderr: | [0;m[38;5;43m20221210140431239 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140431239 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f96a9011c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140431239 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140431239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140431240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140431240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140431250 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140431250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140431250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140431250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:32.453184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16788): Terminating (SIGTERM) 14:04:32.492586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16791): Terminating (SIGTERM) 14:04:32.532059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16794): Terminating (SIGTERM) 14:04:32.572005 --- ParallelTerminationStrategy: PID 16788 died... 14:04:32.590806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16788): Terminated: ok {rc=0} 14:04:32.635063 --- ParallelTerminationStrategy: PID 16791 died... 14:04:32.653382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16791): Terminated: ok {rc=0} 14:04:32.697648 --- ParallelTerminationStrategy: PID 16794 died... 14:04:32.715996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16794): Terminated: ok {rc=0} 14:04:32.802006 bus /sierra_3: Setting Powered False 14:04:33.900068 bus /sierra_3: Setting Powered False 14:04:35.015106 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 14:04:36.279456 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:36.286019 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:04:36.338534 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:04:36.365474 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:04:36.417139 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:04:36.468644 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:04:36.495595 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:04:37.047425 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 14:04:37.052645 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:37.063828 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 14:04:37.112725 tst handover.py: using LAC 28928 14:04:37.230882 tst handover.py: using RAC 113 14:04:37.349944 tst handover.py: using CellId 28928 14:04:37.466990 tst handover.py: using BVCI 28929 14:04:37.575067 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 14:04:37.609643 tst handover.py: using LAC 28929 14:04:37.736268 tst handover.py: using RAC 114 14:04:37.866141 tst handover.py: using CellId 28929 14:04:37.990729 tst handover.py: using BVCI 28930 14:04:38.107308 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:38.118726 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:38.129948 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:38.141885 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:38.153860 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:38.166470 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 14:04:38.283015 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 14:04:38.399542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:38.833597 run create_hlr_db(pid=16800): Launched 14:04:38.955360 bus /sierra_2: Setting Powered False 14:04:40.014405 run create_hlr_db(pid=16800): Terminated: ok {rc=0} 14:04:40.402993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16802): Launched 14:04:40.698198 run osmo-hlr_10.42.42.2(pid=16803): Launched 14:04:40.810401 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:41.294068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16805): Launched 14:04:41.589639 run osmo-stp_10.42.42.5(pid=16806): Launched 14:04:41.702917 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:42.213590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16808): Launched 14:04:42.511188 run osmo-msc_10.42.42.6(pid=16809): Launched 14:04:42.676826 run osmo-stp_10.42.42.5(pid=16806): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16806)] 14:04:42.802869 run osmo-stp_10.42.42.5(pid=16806): stdout: | (launched: 2022-12-10_14:04:41.535711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:42.928538 run osmo-stp_10.42.42.5(pid=16806): stderr: | [0;m[38;5;43m20221210140441706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140441706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140441707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140441707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140441708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140441708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140441708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:43.052434 run osmo-stp_10.42.42.5(pid=16806): stdout: | (launched: 2022-12-10_14:04:41.535711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:43.170135 run osmo-stp_10.42.42.5(pid=16806): stderr: | [0;m[38;5;43m20221210140441706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140441706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140441707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140441707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140441708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140441708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140441708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:43.310482 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16806): Process ended prematurely: osmo-stp_10.42.42.5(pid=16806) [trial-2375↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16806)] [trial-2375↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 14:04:43.318451 tst handover.py:18: Test FAILED (6.3 sec) 14:04:43.343736 run osmo-hlr_10.42.42.2(pid=16803): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16803)] 14:04:43.390304 run osmo-hlr_10.42.42.2(pid=16803): stdout: | (launched: 2022-12-10_14:04:40.644380) 14:04:43.438458 run osmo-hlr_10.42.42.2(pid=16803): stderr: | [0;m[1;31m20221210140440817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140440817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140440817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140440817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140440817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140440817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140440829 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140440838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140440838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140440838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:43.505944 run osmo-msc_10.42.42.6(pid=16809): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16809)] 14:04:43.552256 run osmo-msc_10.42.42.6(pid=16809): stdout: | (launched: 2022-12-10_14:04:42.456873) 14:04:43.600461 run osmo-msc_10.42.42.6(pid=16809): stderr: | [0;m[38;5;43m20221210140442729 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140442729 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f97e7a8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140442729 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140442729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140442729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140442730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140442733 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140442733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140442734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140442734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:43.648872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16802): Terminating (SIGTERM) 14:04:43.687428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16805): Terminating (SIGTERM) 14:04:43.725947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16808): Terminating (SIGTERM) 14:04:43.765216 --- ParallelTerminationStrategy: PID 16802 died... 14:04:43.783815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16802): Terminated: ok {rc=0} 14:04:43.828026 --- ParallelTerminationStrategy: PID 16805 died... 14:04:43.846808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16805): Terminated: ok {rc=0} 14:04:43.890114 --- ParallelTerminationStrategy: PID 16808 died... 14:04:43.908548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16808): Terminated: ok {rc=0} 14:04:43.992867 bus /sierra_3: Setting Powered False 14:04:45.091421 bus /sierra_3: Setting Powered False 14:04:46.206768 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 14:04:47.468031 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:47.474603 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:04:47.540351 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:04:47.567866 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:04:47.618113 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:04:47.684621 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:04:47.712345 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:04:48.262837 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 14:04:48.268041 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:48.279193 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:04:48.329649 tst handover.py: using LAC 28930 14:04:48.453379 tst handover.py: using RAC 115 14:04:48.578792 tst handover.py: using CellId 28930 14:04:48.701868 tst handover.py: using BVCI 28931 14:04:48.817376 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:04:48.866342 tst handover.py: using LAC 28931 14:04:48.992096 tst handover.py: using RAC 116 14:04:49.118350 tst handover.py: using CellId 28931 14:04:49.244304 tst handover.py: using BVCI 28932 14:04:49.360060 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:49.371281 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:49.382260 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:49.394105 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:49.405904 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:49.417558 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:04:49.533777 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:04:49.648195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:50.109853 run create_hlr_db(pid=16814): Launched 14:04:50.230396 bus /sierra_2: Setting Powered False 14:04:51.292588 run create_hlr_db(pid=16814): Terminated: ok {rc=0} 14:04:51.703567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16816): Launched 14:04:52.018268 run osmo-hlr_10.42.42.2(pid=16817): Launched 14:04:52.138465 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:52.657989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16819): Launched 14:04:52.973593 run osmo-stp_10.42.42.5(pid=16820): Launched 14:04:53.095430 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:53.641535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16822): Launched 14:04:53.959756 run osmo-msc_10.42.42.6(pid=16823): Launched 14:04:54.137601 run osmo-stp_10.42.42.5(pid=16820): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16820)] 14:04:54.272483 run osmo-stp_10.42.42.5(pid=16820): stdout: | (launched: 2022-12-10_14:04:52.916482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:54.407680 run osmo-stp_10.42.42.5(pid=16820): stderr: | [0;m[38;5;43m20221210140453109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140453109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140453109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140453110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140453110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140453110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140453110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:54.541826 run osmo-stp_10.42.42.5(pid=16820): stdout: | (launched: 2022-12-10_14:04:52.916482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:54.667639 run osmo-stp_10.42.42.5(pid=16820): stderr: | [0;m[38;5;43m20221210140453109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140453109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140453109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140453110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140453110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140453110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140453110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:54.819035 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16820): Process ended prematurely: osmo-stp_10.42.42.5(pid=16820) [trial-2375↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16820)] [trial-2375↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 14:04:54.827904 tst handover.py:18: Test FAILED (6.6 sec) 14:04:54.855377 run osmo-hlr_10.42.42.2(pid=16817): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16817)] 14:04:54.905105 run osmo-hlr_10.42.42.2(pid=16817): stdout: | (launched: 2022-12-10_14:04:51.961383) 14:04:54.956195 run osmo-hlr_10.42.42.2(pid=16817): stderr: | [0;m[1;31m20221210140452159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140452159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140452159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140452159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140452159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140452159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140452172 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140452182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140452182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140452182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:55.027370 run osmo-msc_10.42.42.6(pid=16823): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16823)] 14:04:55.076917 run osmo-msc_10.42.42.6(pid=16823): stdout: | (launched: 2022-12-10_14:04:53.902301) 14:04:55.128229 run osmo-msc_10.42.42.6(pid=16823): stderr: | [0;m[38;5;43m20221210140454221 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140454221 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd8cdc6fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140454221 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140454221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140454222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140454222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140454225 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140454226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140454226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140454226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:55.179830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16816): Terminating (SIGTERM) 14:04:55.221131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16819): Terminating (SIGTERM) 14:04:55.262589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16822): Terminating (SIGTERM) 14:04:55.304240 --- ParallelTerminationStrategy: PID 16816 died... 14:04:55.323943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16816): Terminated: ok {rc=0} 14:04:55.369942 --- ParallelTerminationStrategy: PID 16819 died... 14:04:55.389200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16819): Terminated: ok {rc=0} 14:04:55.434881 --- ParallelTerminationStrategy: PID 16822 died... 14:04:55.454116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16822): Terminated: ok {rc=0} 14:04:55.540565 bus /sierra_3: Setting Powered False 14:04:56.636454 bus /sierra_3: Setting Powered False 14:04:57.748323 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 14:04:59.020838 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:59.026562 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:04:59.090170 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:04:59.117025 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:04:59.170050 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:04:59.233896 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:04:59.260851 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:04:59.806944 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 14:04:59.812357 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:59.823380 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:04:59.870784 tst handover.py: using LAC 28932 14:04:59.989533 tst handover.py: using RAC 117 14:05:00.115943 tst handover.py: using CellId 28932 14:05:00.242059 tst handover.py: using BVCI 28933 14:05:00.358189 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:05:00.406255 tst handover.py: using LAC 28933 14:05:00.531218 tst handover.py: using RAC 118 14:05:00.655575 tst handover.py: using CellId 28933 14:05:00.781922 tst handover.py: using BVCI 28934 14:05:00.904730 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:00.917234 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:00.930111 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:00.945651 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:00.956775 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:00.968678 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:05:01.090103 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:05:01.209284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:01.725842 run create_hlr_db(pid=16831): Launched 14:05:01.867871 bus /sierra_2: Setting Powered False 14:05:02.926695 run create_hlr_db(pid=16831): Terminated: ok {rc=0} 14:05:03.314784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16833): Launched 14:05:03.610513 run osmo-hlr_10.42.42.2(pid=16834): Launched 14:05:03.722619 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:04.205633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16836): Launched 14:05:04.501653 run osmo-stp_10.42.42.5(pid=16837): Launched 14:05:04.614589 run osmo-msc_10.42.42.6: Starting osmo-msc 14:05:05.126939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16839): Launched 14:05:05.423004 run osmo-msc_10.42.42.6(pid=16840): Launched 14:05:05.588428 run osmo-stp_10.42.42.5(pid=16837): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16837)] 14:05:05.714804 run osmo-stp_10.42.42.5(pid=16837): stdout: | (launched: 2022-12-10_14:05:04.447648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:05.840435 run osmo-stp_10.42.42.5(pid=16837): stderr: | [0;m[38;5;43m20221210140504615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140504615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140504615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140504616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140504618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140504618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140504618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:05.964336 run osmo-stp_10.42.42.5(pid=16837): stdout: | (launched: 2022-12-10_14:05:04.447648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:06.081830 run osmo-stp_10.42.42.5(pid=16837): stderr: | [0;m[38;5;43m20221210140504615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140504615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140504615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140504616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140504618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140504618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140504618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:06.222641 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16837): Process ended prematurely: osmo-stp_10.42.42.5(pid=16837) [trial-2375↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16837)] [trial-2375↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 14:05:06.230808 tst handover.py:18: Test FAILED (6.4 sec) 14:05:06.256341 run osmo-hlr_10.42.42.2(pid=16834): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16834)] 14:05:06.303294 run osmo-hlr_10.42.42.2(pid=16834): stdout: | (launched: 2022-12-10_14:05:03.556672) 14:05:06.351910 run osmo-hlr_10.42.42.2(pid=16834): stderr: | [0;m[1;31m20221210140503734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140503734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140503735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140503735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140503735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140503735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140503747 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140503756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140503756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140503756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:06.419944 run osmo-msc_10.42.42.6(pid=16840): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16840)] 14:05:06.466857 run osmo-msc_10.42.42.6(pid=16840): stdout: | (launched: 2022-12-10_14:05:05.369095) 14:05:06.515220 run osmo-msc_10.42.42.6(pid=16840): stderr: | [0;m[38;5;43m20221210140505639 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140505639 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd2d17d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140505639 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140505639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140505640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140505640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140505642 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140505642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140505642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140505642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:05:06.564073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16833): Terminating (SIGTERM) 14:05:06.602929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16836): Terminating (SIGTERM) 14:05:06.641999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16839): Terminating (SIGTERM) 14:05:06.681504 --- ParallelTerminationStrategy: PID 16833 died... 14:05:06.700268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16833): Terminated: ok {rc=0} 14:05:06.743823 --- ParallelTerminationStrategy: PID 16836 died... 14:05:06.762660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16836): Terminated: ok {rc=0} 14:05:06.805930 --- ParallelTerminationStrategy: PID 16839 died... 14:05:06.824300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16839): Terminated: ok {rc=0} 14:05:06.905877 bus /sierra_3: Setting Powered False 14:05:08.001899 bus /sierra_3: Setting Powered False 14:05:09.115926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 14:05:10.387749 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:05:10.393723 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:05:10.443250 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:05:10.469146 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:05:10.521418 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:05:10.574107 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:05:10.601260 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:05:11.149618 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 14:05:11.155947 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:05:11.167662 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:05:11.201479 tst handover.py: using LAC 28934 14:05:11.319036 tst handover.py: using RAC 119 14:05:11.433397 tst handover.py: using CellId 28934 14:05:11.547591 tst handover.py: using BVCI 28935 14:05:11.654426 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:05:11.699849 tst handover.py: using LAC 28935 14:05:11.825080 tst handover.py: using RAC 120 14:05:11.947512 tst handover.py: using CellId 28935 14:05:12.071875 tst handover.py: using BVCI 28936 14:05:12.187351 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:05:12.198512 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:05:12.209632 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:05:12.220574 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:05:12.231685 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:05:12.242696 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:05:12.357473 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:05:12.474130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:12.936910 run create_hlr_db(pid=16845): Launched 14:05:13.058959 bus /sierra_2: Setting Powered False 14:05:14.121867 run create_hlr_db(pid=16845): Terminated: ok {rc=0} 14:05:14.534513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16847): Launched 14:05:14.851243 run osmo-hlr_10.42.42.2(pid=16848): Launched 14:05:14.972560 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:15.493543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16850): Launched 14:05:15.809615 run osmo-stp_10.42.42.5(pid=16851): Launched 14:05:16.034955 run osmo-msc_10.42.42.6: Starting osmo-msc 14:05:16.718711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16853): Launched 14:05:17.057703 run osmo-msc_10.42.42.6(pid=16854): Launched 14:05:17.374242 run osmo-stp_10.42.42.5(pid=16851): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16851)] 14:05:17.511575 run osmo-stp_10.42.42.5(pid=16851): stdout: | (launched: 2022-12-10_14:05:15.752266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:17.646309 run osmo-stp_10.42.42.5(pid=16851): stderr: | [0;m[38;5;43m20221210140516070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140516070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140516070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140516071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140516071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140516071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140516071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:17.779218 run osmo-stp_10.42.42.5(pid=16851): stdout: | (launched: 2022-12-10_14:05:15.752266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:17.905190 run osmo-stp_10.42.42.5(pid=16851): stderr: | [0;m[38;5;43m20221210140516070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140516070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140516070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140516071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140516071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140516071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140516071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:18.055820 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16851): Process ended prematurely: osmo-stp_10.42.42.5(pid=16851) [trial-2375↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16851)] [trial-2375↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 14:05:18.064724 tst handover.py:18: Test FAILED (6.9 sec) 14:05:18.092189 run osmo-hlr_10.42.42.2(pid=16848): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16848)] 14:05:18.142051 run osmo-hlr_10.42.42.2(pid=16848): stdout: | (launched: 2022-12-10_14:05:14.793559) 14:05:18.193104 run osmo-hlr_10.42.42.2(pid=16848): stderr: | [0;m[1;31m20221210140514993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140514993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140514993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140514993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140514993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140514993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140515006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140515014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140515014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140515014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:18.264269 run osmo-msc_10.42.42.6(pid=16854): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16854)] 14:05:18.313684 run osmo-msc_10.42.42.6(pid=16854): stdout: | (launched: 2022-12-10_14:05:16.991420) 14:05:18.364512 run osmo-msc_10.42.42.6(pid=16854): stderr: | [0;m[38;5;43m20221210140517349 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140517349 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f13bd6abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140517349 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140517349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140517349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140517350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140517353 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140517353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140517354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140517354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:05:18.416207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16847): Terminating (SIGTERM) 14:05:18.457383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16850): Terminating (SIGTERM) 14:05:18.499140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16853): Terminating (SIGTERM) 14:05:18.540806 --- ParallelTerminationStrategy: PID 16847 died... 14:05:18.560554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16847): Terminated: ok {rc=0} 14:05:18.606922 --- ParallelTerminationStrategy: PID 16850 died... 14:05:18.626325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16850): Terminated: ok {rc=0} 14:05:18.672273 --- ParallelTerminationStrategy: PID 16853 died... 14:05:18.691657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16853): Terminated: ok {rc=0} 14:05:18.778618 bus /sierra_3: Setting Powered False 14:05:19.875686 bus /sierra_3: Setting Powered False 14:05:20.989452 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 14:05:22.242645 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:05:22.248180 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:05:22.299535 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:05:22.326862 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:05:22.378521 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:05:22.429408 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:05:22.456782 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:05:23.005177 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 14:05:23.010597 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:23.021780 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:05:23.058000 tst handover.py: using LAC 28936 14:05:23.182842 tst handover.py: using RAC 121 14:05:23.307161 tst handover.py: using CellId 28936 14:05:23.426030 tst handover.py: using BVCI 28937 14:05:23.533876 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:05:23.580580 tst handover.py: using LAC 28937 14:05:23.698525 tst handover.py: using RAC 122 14:05:23.814482 tst handover.py: using CellId 28937 14:05:23.930984 tst handover.py: using BVCI 28938 14:05:24.040499 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:24.051330 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:24.061954 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:24.072473 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:24.083042 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:24.093324 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:05:24.209219 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:05:24.323450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:24.759673 run create_hlr_db(pid=16859): Launched 14:05:24.881253 bus /sierra_2: Setting Powered False 14:05:25.940810 run create_hlr_db(pid=16859): Terminated: ok {rc=0} 14:05:26.346613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16861): Launched 14:05:26.663557 run osmo-hlr_10.42.42.2(pid=16862): Launched 14:05:26.786569 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:27.307859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16864): Launched 14:05:27.625549 run osmo-stp_10.42.42.5(pid=16865): Launched 14:05:27.748456 run osmo-msc_10.42.42.6: Starting osmo-msc 14:05:28.297493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16867): Launched 14:05:28.615698 run osmo-msc_10.42.42.6(pid=16868): Launched 14:05:28.794538 run osmo-stp_10.42.42.5(pid=16865): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16865)] 14:05:28.929414 run osmo-stp_10.42.42.5(pid=16865): stdout: | (launched: 2022-12-10_14:05:27.568312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:29.064282 run osmo-stp_10.42.42.5(pid=16865): stderr: | [0;m[38;5;43m20221210140527758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140527758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140527759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140527759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140527761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140527762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140527762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:29.198793 run osmo-stp_10.42.42.5(pid=16865): stdout: | (launched: 2022-12-10_14:05:27.568312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:29.325413 run osmo-stp_10.42.42.5(pid=16865): stderr: | [0;m[38;5;43m20221210140527758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140527758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140527759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140527759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140527761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140527762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140527762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:29.477412 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16865): Process ended prematurely: osmo-stp_10.42.42.5(pid=16865) [trial-2375↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16865)] [trial-2375↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 14:05:29.486412 tst handover.py:18: Test FAILED (6.5 sec) 14:05:29.514056 run osmo-hlr_10.42.42.2(pid=16862): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16862)] 14:05:29.564516 run osmo-hlr_10.42.42.2(pid=16862): stdout: | (launched: 2022-12-10_14:05:26.606240) 14:05:29.616201 run osmo-hlr_10.42.42.2(pid=16862): stderr: | [0;m[1;31m20221210140526802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140526802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140526802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140526802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140526802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140526802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140526814 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140526822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140526822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140526822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:29.688402 run osmo-msc_10.42.42.6(pid=16868): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16868)] 14:05:29.739046 run osmo-msc_10.42.42.6(pid=16868): stdout: | (launched: 2022-12-10_14:05:28.557980) 14:05:29.791177 run osmo-msc_10.42.42.6(pid=16868): stderr: | [0;m[38;5;43m20221210140528879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140528879 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5ec17d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140528879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140528879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140528880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140528880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140528882 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140528882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140528882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140528882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:05:29.843388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16861): Terminating (SIGTERM) 14:05:29.885211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16864): Terminating (SIGTERM) 14:05:29.927254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16867): Terminating (SIGTERM) 14:05:29.969495 --- ParallelTerminationStrategy: PID 16861 died... 14:05:29.989339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16861): Terminated: ok {rc=0} 14:05:30.035986 --- ParallelTerminationStrategy: PID 16864 died... 14:05:30.055712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16864): Terminated: ok {rc=0} 14:05:30.101945 --- ParallelTerminationStrategy: PID 16867 died... 14:05:30.121385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16867): Terminated: ok {rc=0} 14:05:30.209442 bus /sierra_3: Setting Powered False 14:05:31.305335 bus /sierra_3: Setting Powered False 14:05:32.423847 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2375 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 14:05:33.676290 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:05:33.682011 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:05:33.744651 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:05:33.771734 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:05:33.823065 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:05:33.885786 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:05:33.912761 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:05:34.463162 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2375 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 14:05:34.470346 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:34.481271 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:05:34.527722 tst handover.py: using LAC 28938 14:05:34.643075 tst handover.py: using RAC 123 14:05:34.758325 tst handover.py: using CellId 28938 14:05:34.873398 tst handover.py: using BVCI 28939 14:05:34.980861 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:05:35.030767 tst handover.py: using LAC 28939 14:05:35.146537 tst handover.py: using RAC 124 14:05:35.265349 tst handover.py: using CellId 28939 14:05:35.382364 tst handover.py: using BVCI 28940 14:05:35.490892 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:35.501545 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:35.512141 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:35.522858 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:35.533509 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:05:35.544015 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:05:35.661300 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:05:35.780096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:36.216016 run create_hlr_db(pid=16873): Launched 14:05:36.338538 bus /sierra_2: Setting Powered False 14:05:37.398300 run create_hlr_db(pid=16873): Terminated: ok {rc=0} 14:05:37.806148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16875): Launched 14:05:38.123790 run osmo-hlr_10.42.42.2(pid=16876): Launched 14:05:38.245361 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:38.769532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16878): Launched 14:05:39.087682 run osmo-stp_10.42.42.5(pid=16879): Launched 14:05:39.209039 run osmo-msc_10.42.42.6: Starting osmo-msc 14:05:39.755390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16881): Launched 14:05:40.072794 run osmo-msc_10.42.42.6(pid=16882): Launched 14:05:40.250032 run osmo-stp_10.42.42.5(pid=16879): ERR: Terminated: ERROR {rc=1} [trial-2375↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16879)] 14:05:40.385419 run osmo-stp_10.42.42.5(pid=16879): stdout: | (launched: 2022-12-10_14:05:39.029998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:40.520092 run osmo-stp_10.42.42.5(pid=16879): stderr: | [0;m[38;5;43m20221210140539220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140539221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140539221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140539221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140539222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140539222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140539222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:40.655096 run osmo-stp_10.42.42.5(pid=16879): stdout: | (launched: 2022-12-10_14:05:39.029998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:40.781703 run osmo-stp_10.42.42.5(pid=16879): stderr: | [0;m[38;5;43m20221210140539220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210140539221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210140539221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210140539221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210140539222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210140539222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210140539222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:40.932424 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16879): Process ended prematurely: osmo-stp_10.42.42.5(pid=16879) [trial-2375↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16879)] [trial-2375↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 14:05:40.941191 tst handover.py:18: Test FAILED (6.5 sec) 14:05:40.969185 run osmo-hlr_10.42.42.2(pid=16876): ERR: Terminated: ERROR {rc=237} [trial-2375↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16876)] 14:05:41.019452 run osmo-hlr_10.42.42.2(pid=16876): stdout: | (launched: 2022-12-10_14:05:38.066336) 14:05:41.071016 run osmo-hlr_10.42.42.2(pid=16876): stderr: | [0;m[1;31m20221210140538266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210140538266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210140538266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210140538266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210140538266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210140538266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210140538279 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210140538289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210140538289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210140538289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:41.143306 run osmo-msc_10.42.42.6(pid=16882): ERR: Terminated: ERROR {rc=2} [trial-2375↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16882)] 14:05:41.193317 run osmo-msc_10.42.42.6(pid=16882): stdout: | (launched: 2022-12-10_14:05:40.015385) 14:05:41.245055 run osmo-msc_10.42.42.6(pid=16882): stderr: | [0;m[38;5;43m20221210140540336 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210140540336 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f09788e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210140540337 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210140540337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210140540337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210140540337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210140540339 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210140540339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210140540339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210140540339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:05:41.297216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16875): Terminating (SIGTERM) 14:05:41.339331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16878): Terminating (SIGTERM) 14:05:41.381242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16881): Terminating (SIGTERM) 14:05:41.423066 --- ParallelTerminationStrategy: PID 16875 died... 14:05:41.443318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16875): Terminated: ok {rc=0} 14:05:41.489532 --- ParallelTerminationStrategy: PID 16878 died... 14:05:41.508817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16878): Terminated: ok {rc=0} 14:05:41.554393 --- ParallelTerminationStrategy: PID 16881 died... 14:05:41.573544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16881): Terminated: ok {rc=0} 14:05:41.661146 bus /sierra_3: Setting Powered False 14:05:42.756869 bus /sierra_3: Setting Powered False 14:05:43.870559 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2375 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 14:05:45.133707 tst trial-2375: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375/run.2022-12-10_12-42-03/trial-2375.xml -------------------------------------------------------------------------------------------- trial-2375 FAIL -------------------------------------------------------------------------------------------- 14:05:47.092765 tst trial-2375: trial-2375: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=9213): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9213) [trial-2375↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9213)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.0 sec) Error: osmo-stp_10.42.42.5(pid=9225): Process ended prematurely: osmo-stp_10.42.42.5(pid=9225) [trial-2375↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9225)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=9235): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9235) [trial-2375↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9235)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9248): Process ended prematurely: osmo-stp_10.42.42.5(pid=9248) [trial-2375↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9248)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9262): Process ended prematurely: osmo-stp_10.42.42.5(pid=9262) [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9262)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9276): Process ended prematurely: osmo-stp_10.42.42.5(pid=9276) [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9276)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9290): Process ended prematurely: osmo-stp_10.42.42.5(pid=9290) [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9290)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9301): Process ended prematurely: osmo-stp_10.42.42.5(pid=9301) [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9301)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9315): Process ended prematurely: osmo-stp_10.42.42.5(pid=9315) [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9315)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9326): Process ended prematurely: osmo-stp_10.42.42.5(pid=9326) [trial-2375↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9326)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9341): Process ended prematurely: osmo-stp_10.42.42.5(pid=9341) [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9341)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9352): Process ended prematurely: osmo-stp_10.42.42.5(pid=9352) [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9352)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9366): Process ended prematurely: osmo-stp_10.42.42.5(pid=9366) [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9366)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9377): Process ended prematurely: osmo-stp_10.42.42.5(pid=9377) [trial-2375↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9377)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9391): Process ended prematurely: osmo-stp_10.42.42.5(pid=9391) [trial-2375↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9391)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9402): Process ended prematurely: osmo-stp_10.42.42.5(pid=9402) [trial-2375↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9402)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9417): Process ended prematurely: osmo-stp_10.42.42.5(pid=9417) [trial-2375↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9417)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9428): Process ended prematurely: osmo-stp_10.42.42.5(pid=9428) [trial-2375↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9428)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9442): Process ended prematurely: osmo-stp_10.42.42.5(pid=9442) [trial-2375↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9442)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9455): Process ended prematurely: osmo-stp_10.42.42.5(pid=9455) [trial-2375↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9455)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=9474): Process ended prematurely: osmo-stp_10.42.42.5(pid=9474) [trial-2375↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9474)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=9486): Process ended prematurely: osmo-stp_10.42.42.5(pid=9486) [trial-2375↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9486)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=9504): Process ended prematurely: osmo-stp_10.42.42.5(pid=9504) [trial-2375↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9504)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9514): Process ended prematurely: osmo-stp_10.42.42.5(pid=9514) [trial-2375↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9514)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=9524): Process ended prematurely: osmo-stp_10.42.42.5(pid=9524) [trial-2375↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9524)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=9541): Process ended prematurely: osmo-stp_10.42.42.5(pid=9541) [trial-2375↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9541)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=9553): Process ended prematurely: osmo-stp_10.42.42.5(pid=9553) [trial-2375↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9553)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=9572): Process ended prematurely: osmo-stp_10.42.42.5(pid=9572) [trial-2375↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9572)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9582): Process ended prematurely: osmo-stp_10.42.42.5(pid=9582) [trial-2375↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9582)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9592): Process ended prematurely: osmo-stp_10.42.42.5(pid=9592) [trial-2375↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9592)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=9612): Process ended prematurely: osmo-stp_10.42.42.5(pid=9612) [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9612)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=9624): Process ended prematurely: osmo-stp_10.42.42.5(pid=9624) [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9624)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=9643): Process ended prematurely: osmo-stp_10.42.42.5(pid=9643) [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9643)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9653): Process ended prematurely: osmo-stp_10.42.42.5(pid=9653) [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9653)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9663): Process ended prematurely: osmo-stp_10.42.42.5(pid=9663) [trial-2375↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9663)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=9680): Process ended prematurely: osmo-stp_10.42.42.5(pid=9680) [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9680)] FAIL: iperf3.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=9693): Process ended prematurely: osmo-stp_10.42.42.5(pid=9693) [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9693)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=9711): Process ended prematurely: osmo-stp_10.42.42.5(pid=9711) [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9711)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=9721): Process ended prematurely: osmo-stp_10.42.42.5(pid=9721) [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9721)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9731): Process ended prematurely: osmo-stp_10.42.42.5(pid=9731) [trial-2375↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9731)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9745): Process ended prematurely: osmo-stp_10.42.42.5(pid=9745) [trial-2375↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9745)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9759): Process ended prematurely: osmo-stp_10.42.42.5(pid=9759) [trial-2375↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9759)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=9767): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9767) [trial-2375↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9767)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9777): Process ended prematurely: osmo-stp_10.42.42.5(pid=9777) [trial-2375↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9777)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9786): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9786) [trial-2375↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9786)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=9798): Process ended prematurely: osmo-stp_10.42.42.5(pid=9798) [trial-2375↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9798)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9812): Process ended prematurely: osmo-stp_10.42.42.5(pid=9812) [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9812)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9823): Process ended prematurely: osmo-stp_10.42.42.5(pid=9823) [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9823)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=10110): Process ended prematurely: osmo-stp_10.42.42.5(pid=10110) [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10110)] FAIL: mo_mt_call_osmux.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=10121): Process ended prematurely: osmo-stp_10.42.42.5(pid=10121) [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10121)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10136): Process ended prematurely: osmo-stp_10.42.42.5(pid=10136) [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10136)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10147): Process ended prematurely: osmo-stp_10.42.42.5(pid=10147) [trial-2375↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10147)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10161): Process ended prematurely: osmo-stp_10.42.42.5(pid=10161) [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10161)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10172): Process ended prematurely: osmo-stp_10.42.42.5(pid=10172) [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10172)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10186): Process ended prematurely: osmo-stp_10.42.42.5(pid=10186) [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10186)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10197): Process ended prematurely: osmo-stp_10.42.42.5(pid=10197) [trial-2375↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10197)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10211): Process ended prematurely: osmo-stp_10.42.42.5(pid=10211) [trial-2375↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10211)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10222): Process ended prematurely: osmo-stp_10.42.42.5(pid=10222) [trial-2375↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10222)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10246): Process ended prematurely: osmo-stp_10.42.42.5(pid=10246) [trial-2375↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10246)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10609): Process ended prematurely: osmo-stp_10.42.42.5(pid=10609) [trial-2375↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10609)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10799): Process ended prematurely: osmo-stp_10.42.42.5(pid=10799) [trial-2375↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10799)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10810): Process ended prematurely: osmo-stp_10.42.42.5(pid=10810) [trial-2375↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10810)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=10828): Process ended prematurely: osmo-stp_10.42.42.5(pid=10828) [trial-2375↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10828)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=10840): Process ended prematurely: osmo-stp_10.42.42.5(pid=10840) [trial-2375↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10840)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=10858): Process ended prematurely: osmo-stp_10.42.42.5(pid=10858) [trial-2375↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10858)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10868): Process ended prematurely: osmo-stp_10.42.42.5(pid=10868) [trial-2375↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10868)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10878): Process ended prematurely: osmo-stp_10.42.42.5(pid=10878) [trial-2375↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10878)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=10895): Process ended prematurely: osmo-stp_10.42.42.5(pid=10895) [trial-2375↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10895)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=10919): Process ended prematurely: osmo-stp_10.42.42.5(pid=10919) [trial-2375↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10919)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=10937): Process ended prematurely: osmo-stp_10.42.42.5(pid=10937) [trial-2375↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10937)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10950): Process ended prematurely: osmo-stp_10.42.42.5(pid=10950) [trial-2375↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10950)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10960): Process ended prematurely: osmo-stp_10.42.42.5(pid=10960) [trial-2375↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10960)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=10977): Process ended prematurely: osmo-stp_10.42.42.5(pid=10977) [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10977)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=10989): Process ended prematurely: osmo-stp_10.42.42.5(pid=10989) [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10989)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=11009): Process ended prematurely: osmo-stp_10.42.42.5(pid=11009) [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11009)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11039): Process ended prematurely: osmo-stp_10.42.42.5(pid=11039) [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11039)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=11050): Process ended prematurely: osmo-stp_10.42.42.5(pid=11050) [trial-2375↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11050)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11067): Process ended prematurely: osmo-stp_10.42.42.5(pid=11067) [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11067)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11079): Process ended prematurely: osmo-stp_10.42.42.5(pid=11079) [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11079)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=11097): Process ended prematurely: osmo-stp_10.42.42.5(pid=11097) [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11097)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11107): Process ended prematurely: osmo-stp_10.42.42.5(pid=11107) [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11107)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11117): Process ended prematurely: osmo-stp_10.42.42.5(pid=11117) [trial-2375↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11117)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11130): Process ended prematurely: osmo-stp_10.42.42.5(pid=11130) [trial-2375↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11130)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11147): Process ended prematurely: osmo-stp_10.42.42.5(pid=11147) [trial-2375↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11147)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=11155): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11155) [trial-2375↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11155)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=11165): Process ended prematurely: osmo-stp_10.42.42.5(pid=11165) [trial-2375↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11165)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=11174): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11174) [trial-2375↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11174)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=11184): Process ended prematurely: osmo-stp_10.42.42.5(pid=11184) [trial-2375↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11184)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11199): Process ended prematurely: osmo-stp_10.42.42.5(pid=11199) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11199)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11210): Process ended prematurely: osmo-stp_10.42.42.5(pid=11210) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11210)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=11225): Process ended prematurely: osmo-stp_10.42.42.5(pid=11225) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11225)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11236): Process ended prematurely: osmo-stp_10.42.42.5(pid=11236) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11236)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11250): Process ended prematurely: osmo-stp_10.42.42.5(pid=11250) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11261): Process ended prematurely: osmo-stp_10.42.42.5(pid=11261) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11261)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=11275): Process ended prematurely: osmo-stp_10.42.42.5(pid=11275) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11275)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11286): Process ended prematurely: osmo-stp_10.42.42.5(pid=11286) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11286)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11300): Process ended prematurely: osmo-stp_10.42.42.5(pid=11300) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11300)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11311): Process ended prematurely: osmo-stp_10.42.42.5(pid=11311) [trial-2375↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11311)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11325): Process ended prematurely: osmo-stp_10.42.42.5(pid=11325) [trial-2375↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11325)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11338): Process ended prematurely: osmo-stp_10.42.42.5(pid=11338) [trial-2375↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11338)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11352): Process ended prematurely: osmo-stp_10.42.42.5(pid=11352) [trial-2375↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11352)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11364): Process ended prematurely: osmo-stp_10.42.42.5(pid=11364) [trial-2375↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11364)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11378): Process ended prematurely: osmo-stp_10.42.42.5(pid=11378) [trial-2375↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11378)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11389): Process ended prematurely: osmo-stp_10.42.42.5(pid=11389) [trial-2375↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11389)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11404): Process ended prematurely: osmo-stp_10.42.42.5(pid=11404) [trial-2375↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11404)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11415): Process ended prematurely: osmo-stp_10.42.42.5(pid=11415) [trial-2375↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11415)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11429): Process ended prematurely: osmo-stp_10.42.42.5(pid=11429) [trial-2375↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11429)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11440): Process ended prematurely: osmo-stp_10.42.42.5(pid=11440) [trial-2375↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11440)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=11458): Process ended prematurely: osmo-stp_10.42.42.5(pid=11458) [trial-2375↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11458)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11470): Process ended prematurely: osmo-stp_10.42.42.5(pid=11470) [trial-2375↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11470)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=11488): Process ended prematurely: osmo-stp_10.42.42.5(pid=11488) [trial-2375↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11488)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11501): Process ended prematurely: osmo-stp_10.42.42.5(pid=11501) [trial-2375↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11501)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11511): Process ended prematurely: osmo-stp_10.42.42.5(pid=11511) [trial-2375↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11511)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11529): Process ended prematurely: osmo-stp_10.42.42.5(pid=11529) [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11529)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=11541): Process ended prematurely: osmo-stp_10.42.42.5(pid=11541) [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11541)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=11559): Process ended prematurely: osmo-stp_10.42.42.5(pid=11559) [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11559)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11570): Process ended prematurely: osmo-stp_10.42.42.5(pid=11570) [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11570)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11580): Process ended prematurely: osmo-stp_10.42.42.5(pid=11580) [trial-2375↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11580)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=11598): Process ended prematurely: osmo-stp_10.42.42.5(pid=11598) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11598)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=11610): Process ended prematurely: osmo-stp_10.42.42.5(pid=11610) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11610)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=11628): Process ended prematurely: osmo-stp_10.42.42.5(pid=11628) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11628)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11641): Process ended prematurely: osmo-stp_10.42.42.5(pid=11641) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11641)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11651): Process ended prematurely: osmo-stp_10.42.42.5(pid=11651) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11651)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=11668): Process ended prematurely: osmo-stp_10.42.42.5(pid=11668) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11668)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=11680): Process ended prematurely: osmo-stp_10.42.42.5(pid=11680) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11680)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=11698): Process ended prematurely: osmo-stp_10.42.42.5(pid=11698) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11698)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11708): Process ended prematurely: osmo-stp_10.42.42.5(pid=11708) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11708)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11718): Process ended prematurely: osmo-stp_10.42.42.5(pid=11718) [trial-2375↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11718)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=12007): Process ended prematurely: osmo-stp_10.42.42.5(pid=12007) [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12007)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=12020): Process ended prematurely: osmo-stp_10.42.42.5(pid=12020) [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12020)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=12038): Process ended prematurely: osmo-stp_10.42.42.5(pid=12038) [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12038)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12049): Process ended prematurely: osmo-stp_10.42.42.5(pid=12049) [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12049)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12059): Process ended prematurely: osmo-stp_10.42.42.5(pid=12059) [trial-2375↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12059)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12073): Process ended prematurely: osmo-stp_10.42.42.5(pid=12073) [trial-2375↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12073)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12086): Process ended prematurely: osmo-stp_10.42.42.5(pid=12086) [trial-2375↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12086)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12094) [trial-2375↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12094)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12104): Process ended prematurely: osmo-stp_10.42.42.5(pid=12104) [trial-2375↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12104)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=12116): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12116) [trial-2375↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12116)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12126): Process ended prematurely: osmo-stp_10.42.42.5(pid=12126) [trial-2375↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12126)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12140): Process ended prematurely: osmo-stp_10.42.42.5(pid=12140) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12140)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12151): Process ended prematurely: osmo-stp_10.42.42.5(pid=12151) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12151)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12166): Process ended prematurely: osmo-stp_10.42.42.5(pid=12166) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12166)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12177): Process ended prematurely: osmo-stp_10.42.42.5(pid=12177) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12177)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12191): Process ended prematurely: osmo-stp_10.42.42.5(pid=12191) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12191)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12202): Process ended prematurely: osmo-stp_10.42.42.5(pid=12202) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12202)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12217): Process ended prematurely: osmo-stp_10.42.42.5(pid=12217) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12217)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12229): Process ended prematurely: osmo-stp_10.42.42.5(pid=12229) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12229)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12243): Process ended prematurely: osmo-stp_10.42.42.5(pid=12243) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12243)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12254): Process ended prematurely: osmo-stp_10.42.42.5(pid=12254) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12254)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12269): Process ended prematurely: osmo-stp_10.42.42.5(pid=12269) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12269)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12280): Process ended prematurely: osmo-stp_10.42.42.5(pid=12280) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12280)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12294): Process ended prematurely: osmo-stp_10.42.42.5(pid=12294) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12294)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12306): Process ended prematurely: osmo-stp_10.42.42.5(pid=12306) [trial-2375↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12306)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12320): Process ended prematurely: osmo-stp_10.42.42.5(pid=12320) [trial-2375↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12320)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12331): Process ended prematurely: osmo-stp_10.42.42.5(pid=12331) [trial-2375↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12331)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=12349): Process ended prematurely: osmo-stp_10.42.42.5(pid=12349) [trial-2375↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12349)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=12361): Process ended prematurely: osmo-stp_10.42.42.5(pid=12361) [trial-2375↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12361)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=12379): Process ended prematurely: osmo-stp_10.42.42.5(pid=12379) [trial-2375↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12379)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12389): Process ended prematurely: osmo-stp_10.42.42.5(pid=12389) [trial-2375↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12389)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12399): Process ended prematurely: osmo-stp_10.42.42.5(pid=12399) [trial-2375↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12399)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=12418): Process ended prematurely: osmo-stp_10.42.42.5(pid=12418) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12418)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=12430): Process ended prematurely: osmo-stp_10.42.42.5(pid=12430) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12430)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=12448): Process ended prematurely: osmo-stp_10.42.42.5(pid=12448) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12448)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12458): Process ended prematurely: osmo-stp_10.42.42.5(pid=12458) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12458)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12471): Process ended prematurely: osmo-stp_10.42.42.5(pid=12471) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12471)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=12488): Process ended prematurely: osmo-stp_10.42.42.5(pid=12488) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12488)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=12500): Process ended prematurely: osmo-stp_10.42.42.5(pid=12500) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12500)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=12518): Process ended prematurely: osmo-stp_10.42.42.5(pid=12518) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12518)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12528): Process ended prematurely: osmo-stp_10.42.42.5(pid=12528) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12528)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12538): Process ended prematurely: osmo-stp_10.42.42.5(pid=12538) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12538)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=12555): Process ended prematurely: osmo-stp_10.42.42.5(pid=12555) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12555)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=12567): Process ended prematurely: osmo-stp_10.42.42.5(pid=12567) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12567)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=12586): Process ended prematurely: osmo-stp_10.42.42.5(pid=12586) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12586)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12596): Process ended prematurely: osmo-stp_10.42.42.5(pid=12596) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12596)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12607): Process ended prematurely: osmo-stp_10.42.42.5(pid=12607) [trial-2375↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12607)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12623): Process ended prematurely: osmo-stp_10.42.42.5(pid=12623) [trial-2375↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12623)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12637): Process ended prematurely: osmo-stp_10.42.42.5(pid=12637) [trial-2375↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12637)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12645): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12645) [trial-2375↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12645)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=12657): Process ended prematurely: osmo-stp_10.42.42.5(pid=12657) [trial-2375↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12657)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12666): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12666) [trial-2375↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12666)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=12676): Process ended prematurely: osmo-stp_10.42.42.5(pid=12676) [trial-2375↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12676)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12690): Process ended prematurely: osmo-stp_10.42.42.5(pid=12690) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12690)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12701): Process ended prematurely: osmo-stp_10.42.42.5(pid=12701) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12701)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12715): Process ended prematurely: osmo-stp_10.42.42.5(pid=12715) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12715)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12726): Process ended prematurely: osmo-stp_10.42.42.5(pid=12726) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12726)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12740): Process ended prematurely: osmo-stp_10.42.42.5(pid=12740) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12740)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12751): Process ended prematurely: osmo-stp_10.42.42.5(pid=12751) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12751)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12766): Process ended prematurely: osmo-stp_10.42.42.5(pid=12766) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12766)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12777): Process ended prematurely: osmo-stp_10.42.42.5(pid=12777) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12777)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12792): Process ended prematurely: osmo-stp_10.42.42.5(pid=12792) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12792)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12803): Process ended prematurely: osmo-stp_10.42.42.5(pid=12803) [trial-2375↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12803)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12817): Process ended prematurely: osmo-stp_10.42.42.5(pid=12817) [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12817)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12828): Process ended prematurely: osmo-stp_10.42.42.5(pid=12828) [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12828)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12846): Process ended prematurely: osmo-stp_10.42.42.5(pid=12846) [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12846)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12857): Process ended prematurely: osmo-stp_10.42.42.5(pid=12857) [trial-2375↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12857)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12871): Process ended prematurely: osmo-stp_10.42.42.5(pid=12871) [trial-2375↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12871)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12882): Process ended prematurely: osmo-stp_10.42.42.5(pid=12882) [trial-2375↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12882)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12896): Process ended prematurely: osmo-stp_10.42.42.5(pid=12896) [trial-2375↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12896)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12907): Process ended prematurely: osmo-stp_10.42.42.5(pid=12907) [trial-2375↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12907)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=12928): Process ended prematurely: osmo-stp_10.42.42.5(pid=12928) [trial-2375↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12928)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=12940): Process ended prematurely: osmo-stp_10.42.42.5(pid=12940) [trial-2375↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12940)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=12958): Process ended prematurely: osmo-stp_10.42.42.5(pid=12958) [trial-2375↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12958)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12968): Process ended prematurely: osmo-stp_10.42.42.5(pid=12968) [trial-2375↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12968)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12978): Process ended prematurely: osmo-stp_10.42.42.5(pid=12978) [trial-2375↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12978)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=12996): Process ended prematurely: osmo-stp_10.42.42.5(pid=12996) [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12996)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13008): Process ended prematurely: osmo-stp_10.42.42.5(pid=13008) [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13008)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=13028): Process ended prematurely: osmo-stp_10.42.42.5(pid=13028) [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13028)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13038): Process ended prematurely: osmo-stp_10.42.42.5(pid=13038) [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13038)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13048): Process ended prematurely: osmo-stp_10.42.42.5(pid=13048) [trial-2375↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13048)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (10.1 sec) Error: osmo-stp_10.42.42.5(pid=13337): Process ended prematurely: osmo-stp_10.42.42.5(pid=13337) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13337)] FAIL: iperf3.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=13349): Process ended prematurely: osmo-stp_10.42.42.5(pid=13349) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13349)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=13367): Process ended prematurely: osmo-stp_10.42.42.5(pid=13367) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13367)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13377): Process ended prematurely: osmo-stp_10.42.42.5(pid=13377) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13377)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13388): Process ended prematurely: osmo-stp_10.42.42.5(pid=13388) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13388)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13405): Process ended prematurely: osmo-stp_10.42.42.5(pid=13405) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13405)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13418): Process ended prematurely: osmo-stp_10.42.42.5(pid=13418) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13418)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=13436): Process ended prematurely: osmo-stp_10.42.42.5(pid=13436) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13436)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13450): Process ended prematurely: osmo-stp_10.42.42.5(pid=13450) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13450)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13460): Process ended prematurely: osmo-stp_10.42.42.5(pid=13460) [trial-2375↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13460)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=13477): Process ended prematurely: osmo-stp_10.42.42.5(pid=13477) [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13477)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=13489): Process ended prematurely: osmo-stp_10.42.42.5(pid=13489) [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13489)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=13507): Process ended prematurely: osmo-stp_10.42.42.5(pid=13507) [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13507)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13517): Process ended prematurely: osmo-stp_10.42.42.5(pid=13517) [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13517)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13527): Process ended prematurely: osmo-stp_10.42.42.5(pid=13527) [trial-2375↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13527)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13540): Process ended prematurely: osmo-stp_10.42.42.5(pid=13540) [trial-2375↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13540)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=13554): Process ended prematurely: osmo-stp_10.42.42.5(pid=13554) [trial-2375↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13554)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=13563): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13563) [trial-2375↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13563)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13573): Process ended prematurely: osmo-stp_10.42.42.5(pid=13573) [trial-2375↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13573)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=13583): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13583) [trial-2375↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13583)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=13593): Process ended prematurely: osmo-stp_10.42.42.5(pid=13593) [trial-2375↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13593)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13607): Process ended prematurely: osmo-stp_10.42.42.5(pid=13607) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13607)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13618): Process ended prematurely: osmo-stp_10.42.42.5(pid=13618) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13618)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13637): Process ended prematurely: osmo-stp_10.42.42.5(pid=13637) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13637)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13648): Process ended prematurely: osmo-stp_10.42.42.5(pid=13648) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13648)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13663): Process ended prematurely: osmo-stp_10.42.42.5(pid=13663) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13663)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13674): Process ended prematurely: osmo-stp_10.42.42.5(pid=13674) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13674)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13688): Process ended prematurely: osmo-stp_10.42.42.5(pid=13688) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13688)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13699): Process ended prematurely: osmo-stp_10.42.42.5(pid=13699) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13699)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13713): Process ended prematurely: osmo-stp_10.42.42.5(pid=13713) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13713)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13724): Process ended prematurely: osmo-stp_10.42.42.5(pid=13724) [trial-2375↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13724)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13738): Process ended prematurely: osmo-stp_10.42.42.5(pid=13738) [trial-2375↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13738)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13749): Process ended prematurely: osmo-stp_10.42.42.5(pid=13749) [trial-2375↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13749)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13763): Process ended prematurely: osmo-stp_10.42.42.5(pid=13763) [trial-2375↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13763)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13774): Process ended prematurely: osmo-stp_10.42.42.5(pid=13774) [trial-2375↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13774)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13789): Process ended prematurely: osmo-stp_10.42.42.5(pid=13789) [trial-2375↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13789)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13801): Process ended prematurely: osmo-stp_10.42.42.5(pid=13801) [trial-2375↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13801)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13823): Process ended prematurely: osmo-stp_10.42.42.5(pid=13823) [trial-2375↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13823)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13835): Process ended prematurely: osmo-stp_10.42.42.5(pid=13835) [trial-2375↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13835)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=13853): Process ended prematurely: osmo-stp_10.42.42.5(pid=13853) [trial-2375↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13853)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13863): Process ended prematurely: osmo-stp_10.42.42.5(pid=13863) [trial-2375↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13863)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13873): Process ended prematurely: osmo-stp_10.42.42.5(pid=13873) [trial-2375↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13873)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13890): Process ended prematurely: osmo-stp_10.42.42.5(pid=13890) [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13890)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=13902): Process ended prematurely: osmo-stp_10.42.42.5(pid=13902) [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13902)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=13920): Process ended prematurely: osmo-stp_10.42.42.5(pid=13920) [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13920)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13930): Process ended prematurely: osmo-stp_10.42.42.5(pid=13930) [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13930)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13940): Process ended prematurely: osmo-stp_10.42.42.5(pid=13940) [trial-2375↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13940)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=13957): Process ended prematurely: osmo-stp_10.42.42.5(pid=13957) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13957)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13969): Process ended prematurely: osmo-stp_10.42.42.5(pid=13969) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13969)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=13990): Process ended prematurely: osmo-stp_10.42.42.5(pid=13990) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13990)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14000): Process ended prematurely: osmo-stp_10.42.42.5(pid=14000) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14000)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14010): Process ended prematurely: osmo-stp_10.42.42.5(pid=14010) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14010)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=14028): Process ended prematurely: osmo-stp_10.42.42.5(pid=14028) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14028)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14040): Process ended prematurely: osmo-stp_10.42.42.5(pid=14040) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14040)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=14058): Process ended prematurely: osmo-stp_10.42.42.5(pid=14058) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14058)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14068): Process ended prematurely: osmo-stp_10.42.42.5(pid=14068) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14068)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14078): Process ended prematurely: osmo-stp_10.42.42.5(pid=14078) [trial-2375↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14078)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14093): Process ended prematurely: osmo-stp_10.42.42.5(pid=14093) [trial-2375↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14093)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14106): Process ended prematurely: osmo-stp_10.42.42.5(pid=14106) [trial-2375↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14106)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=14114): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14114) [trial-2375↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14114)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14125): Process ended prematurely: osmo-stp_10.42.42.5(pid=14125) [trial-2375↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14125)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=14134): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14134) [trial-2375↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14134)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=14144): Process ended prematurely: osmo-stp_10.42.42.5(pid=14144) [trial-2375↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14144)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14165): Process ended prematurely: osmo-stp_10.42.42.5(pid=14165) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14165)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14176): Process ended prematurely: osmo-stp_10.42.42.5(pid=14176) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14176)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14190): Process ended prematurely: osmo-stp_10.42.42.5(pid=14190) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14190)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14201): Process ended prematurely: osmo-stp_10.42.42.5(pid=14201) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14201)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14215): Process ended prematurely: osmo-stp_10.42.42.5(pid=14215) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14215)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14226): Process ended prematurely: osmo-stp_10.42.42.5(pid=14226) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14226)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14240): Process ended prematurely: osmo-stp_10.42.42.5(pid=14240) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14240)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14251): Process ended prematurely: osmo-stp_10.42.42.5(pid=14251) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14251)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14268): Process ended prematurely: osmo-stp_10.42.42.5(pid=14268) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14268)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14279): Process ended prematurely: osmo-stp_10.42.42.5(pid=14279) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14279)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14293): Process ended prematurely: osmo-stp_10.42.42.5(pid=14293) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14293)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=14304): Process ended prematurely: osmo-stp_10.42.42.5(pid=14304) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14304)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14318): Process ended prematurely: osmo-stp_10.42.42.5(pid=14318) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14318)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14329): Process ended prematurely: osmo-stp_10.42.42.5(pid=14329) [trial-2375↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14329)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14343): Process ended prematurely: osmo-stp_10.42.42.5(pid=14343) [trial-2375↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14343)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14354): Process ended prematurely: osmo-stp_10.42.42.5(pid=14354) [trial-2375↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14354)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14372): Process ended prematurely: osmo-stp_10.42.42.5(pid=14372) [trial-2375↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14372)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=14384): Process ended prematurely: osmo-stp_10.42.42.5(pid=14384) [trial-2375↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14384)] FAIL: iperf3m4.py (12.2 sec) Error: osmo-stp_10.42.42.5(pid=14674): Process ended prematurely: osmo-stp_10.42.42.5(pid=14674) [trial-2375↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14674)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14685): Process ended prematurely: osmo-stp_10.42.42.5(pid=14685) [trial-2375↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14685)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14695): Process ended prematurely: osmo-stp_10.42.42.5(pid=14695) [trial-2375↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14695)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=14712): Process ended prematurely: osmo-stp_10.42.42.5(pid=14712) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14712)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=14724): Process ended prematurely: osmo-stp_10.42.42.5(pid=14724) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14724)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=14742): Process ended prematurely: osmo-stp_10.42.42.5(pid=14742) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14742)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14752): Process ended prematurely: osmo-stp_10.42.42.5(pid=14752) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14752)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14762): Process ended prematurely: osmo-stp_10.42.42.5(pid=14762) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14762)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=14781): Process ended prematurely: osmo-stp_10.42.42.5(pid=14781) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14781)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=14796): Process ended prematurely: osmo-stp_10.42.42.5(pid=14796) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14796)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=14814): Process ended prematurely: osmo-stp_10.42.42.5(pid=14814) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14814)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14824): Process ended prematurely: osmo-stp_10.42.42.5(pid=14824) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14824)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14834): Process ended prematurely: osmo-stp_10.42.42.5(pid=14834) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14834)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=14851): Process ended prematurely: osmo-stp_10.42.42.5(pid=14851) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14851)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=14863): Process ended prematurely: osmo-stp_10.42.42.5(pid=14863) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14863)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=14881): Process ended prematurely: osmo-stp_10.42.42.5(pid=14881) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14881)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14891): Process ended prematurely: osmo-stp_10.42.42.5(pid=14891) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14891)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14901): Process ended prematurely: osmo-stp_10.42.42.5(pid=14901) [trial-2375↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14901)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14916): Process ended prematurely: osmo-stp_10.42.42.5(pid=14916) [trial-2375↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14916)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14939): Process ended prematurely: osmo-stp_10.42.42.5(pid=14939) [trial-2375↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14939)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=14947): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14947) [trial-2375↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14947)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=14957): Process ended prematurely: osmo-stp_10.42.42.5(pid=14957) [trial-2375↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14957)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=14966): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14966) [trial-2375↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14966)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=14976): Process ended prematurely: osmo-stp_10.42.42.5(pid=14976) [trial-2375↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14976)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14990): Process ended prematurely: osmo-stp_10.42.42.5(pid=14990) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14990)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15001): Process ended prematurely: osmo-stp_10.42.42.5(pid=15001) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15001)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=15015): Process ended prematurely: osmo-stp_10.42.42.5(pid=15015) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15015)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15026): Process ended prematurely: osmo-stp_10.42.42.5(pid=15026) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15026)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15041): Process ended prematurely: osmo-stp_10.42.42.5(pid=15041) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15041)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15053): Process ended prematurely: osmo-stp_10.42.42.5(pid=15053) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15053)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15067): Process ended prematurely: osmo-stp_10.42.42.5(pid=15067) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15067)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15078): Process ended prematurely: osmo-stp_10.42.42.5(pid=15078) [trial-2375↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15078)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15092): Process ended prematurely: osmo-stp_10.42.42.5(pid=15092) [trial-2375↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15092)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=15103): Process ended prematurely: osmo-stp_10.42.42.5(pid=15103) [trial-2375↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15103)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15117): Process ended prematurely: osmo-stp_10.42.42.5(pid=15117) [trial-2375↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15117)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15128): Process ended prematurely: osmo-stp_10.42.42.5(pid=15128) [trial-2375↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15128)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=15149): Process ended prematurely: osmo-stp_10.42.42.5(pid=15149) [trial-2375↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15149)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=15161): Process ended prematurely: osmo-stp_10.42.42.5(pid=15161) [trial-2375↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15161)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=15179): Process ended prematurely: osmo-stp_10.42.42.5(pid=15179) [trial-2375↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15179)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15189): Process ended prematurely: osmo-stp_10.42.42.5(pid=15189) [trial-2375↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15189)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15199): Process ended prematurely: osmo-stp_10.42.42.5(pid=15199) [trial-2375↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15199)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=15216): Process ended prematurely: osmo-stp_10.42.42.5(pid=15216) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15216)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=15228): Process ended prematurely: osmo-stp_10.42.42.5(pid=15228) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15228)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=15246): Process ended prematurely: osmo-stp_10.42.42.5(pid=15246) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15246)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15256): Process ended prematurely: osmo-stp_10.42.42.5(pid=15256) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15256)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15266): Process ended prematurely: osmo-stp_10.42.42.5(pid=15266) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15266)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=15283): Process ended prematurely: osmo-stp_10.42.42.5(pid=15283) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15283)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=15296): Process ended prematurely: osmo-stp_10.42.42.5(pid=15296) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15296)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=15314): Process ended prematurely: osmo-stp_10.42.42.5(pid=15314) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15314)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15325): Process ended prematurely: osmo-stp_10.42.42.5(pid=15325) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15325)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15335): Process ended prematurely: osmo-stp_10.42.42.5(pid=15335) [trial-2375↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15335)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15349): Process ended prematurely: osmo-stp_10.42.42.5(pid=15349) [trial-2375↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15349)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=15362): Process ended prematurely: osmo-stp_10.42.42.5(pid=15362) [trial-2375↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15362)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=15371): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15371) [trial-2375↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15371)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=15383): Process ended prematurely: osmo-stp_10.42.42.5(pid=15383) [trial-2375↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15383)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15397): Process ended prematurely: osmo-stp_10.42.42.5(pid=15397) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15397)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15408): Process ended prematurely: osmo-stp_10.42.42.5(pid=15408) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15408)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15430): Process ended prematurely: osmo-stp_10.42.42.5(pid=15430) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15430)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15442): Process ended prematurely: osmo-stp_10.42.42.5(pid=15442) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15442)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15456): Process ended prematurely: osmo-stp_10.42.42.5(pid=15456) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15456)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15467): Process ended prematurely: osmo-stp_10.42.42.5(pid=15467) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15467)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15481): Process ended prematurely: osmo-stp_10.42.42.5(pid=15481) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15481)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15492): Process ended prematurely: osmo-stp_10.42.42.5(pid=15492) [trial-2375↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15492)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15506): Process ended prematurely: osmo-stp_10.42.42.5(pid=15506) [trial-2375↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15506)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15520): Process ended prematurely: osmo-stp_10.42.42.5(pid=15520) [trial-2375↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15520)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15534): Process ended prematurely: osmo-stp_10.42.42.5(pid=15534) [trial-2375↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15534)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15545): Process ended prematurely: osmo-stp_10.42.42.5(pid=15545) [trial-2375↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15545)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15559): Process ended prematurely: osmo-stp_10.42.42.5(pid=15559) [trial-2375↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15559)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15570): Process ended prematurely: osmo-stp_10.42.42.5(pid=15570) [trial-2375↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15570)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=15588): Process ended prematurely: osmo-stp_10.42.42.5(pid=15588) [trial-2375↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15588)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=15600): Process ended prematurely: osmo-stp_10.42.42.5(pid=15600) [trial-2375↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15600)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=15618): Process ended prematurely: osmo-stp_10.42.42.5(pid=15618) [trial-2375↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15618)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15628): Process ended prematurely: osmo-stp_10.42.42.5(pid=15628) [trial-2375↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15628)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15638): Process ended prematurely: osmo-stp_10.42.42.5(pid=15638) [trial-2375↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15638)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=15656): Process ended prematurely: osmo-stp_10.42.42.5(pid=15656) [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15656)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=15668): Process ended prematurely: osmo-stp_10.42.42.5(pid=15668) [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15668)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=15686): Process ended prematurely: osmo-stp_10.42.42.5(pid=15686) [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15686)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15697): Process ended prematurely: osmo-stp_10.42.42.5(pid=15697) [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15697)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15707): Process ended prematurely: osmo-stp_10.42.42.5(pid=15707) [trial-2375↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15707)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=15724): Process ended prematurely: osmo-stp_10.42.42.5(pid=15724) [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15724)] FAIL: iperf3.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=16008): Process ended prematurely: osmo-stp_10.42.42.5(pid=16008) [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16008)] FAIL: iperf3m4.py (12.3 sec) Error: osmo-stp_10.42.42.5(pid=16026): Process ended prematurely: osmo-stp_10.42.42.5(pid=16026) [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16026)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16037): Process ended prematurely: osmo-stp_10.42.42.5(pid=16037) [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16037)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16047): Process ended prematurely: osmo-stp_10.42.42.5(pid=16047) [trial-2375↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16047)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=16065): Process ended prematurely: osmo-stp_10.42.42.5(pid=16065) [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16065)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=16077): Process ended prematurely: osmo-stp_10.42.42.5(pid=16077) [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16077)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=16095): Process ended prematurely: osmo-stp_10.42.42.5(pid=16095) [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16095)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16105): Process ended prematurely: osmo-stp_10.42.42.5(pid=16105) [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16105)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16115): Process ended prematurely: osmo-stp_10.42.42.5(pid=16115) [trial-2375↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16115)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16131): Process ended prematurely: osmo-stp_10.42.42.5(pid=16131) [trial-2375↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16131)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=16139): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16139) [trial-2375↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16139)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=16142): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16142) [trial-2375↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16142)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=16144): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16144) [trial-2375↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16144)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=16146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16146) [trial-2375↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16146)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.2 sec) Error: osmo-hlr_10.42.42.2(pid=16155): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16155) [trial-2375↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16155)] FAIL: esme_connect_policy_closed.py (6.0 sec) Error: osmo-hlr_10.42.42.2(pid=16166): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16166) [trial-2375↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16166)] FAIL: esme_ms_sms_storeforward.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16178): Process ended prematurely: osmo-stp_10.42.42.5(pid=16178) [trial-2375↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16178)] FAIL: esme_ms_sms_transaction.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=16189): Process ended prematurely: osmo-stp_10.42.42.5(pid=16189) [trial-2375↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16189)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16203): Process ended prematurely: osmo-stp_10.42.42.5(pid=16203) [trial-2375↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16203)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16214): Process ended prematurely: osmo-stp_10.42.42.5(pid=16214) [trial-2375↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16214)] FAIL: register_a5_1_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16225): Process ended prematurely: osmo-stp_10.42.42.5(pid=16225) [trial-2375↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16225)] FAIL: register_a5_3_authreq.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16236): Process ended prematurely: osmo-stp_10.42.42.5(pid=16236) [trial-2375↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16236)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.8 sec) Error: srsepc(pid=16256): Process ended prematurely: srsepc(pid=16256) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16256)] FAIL: iperf3_bidir.py (18.5 sec) Error: srsepc(pid=16272): Process ended prematurely: srsepc(pid=16272) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16272)] FAIL: iperf3_dl.py (18.5 sec) Error: srsepc(pid=16288): Process ended prematurely: srsepc(pid=16288) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16288)] FAIL: iperf3_ul.py (18.7 sec) Error: srsepc(pid=16307): Process ended prematurely: srsepc(pid=16307) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16307)] FAIL: ping.py (18.1 sec) Error: srsepc(pid=16323): Process ended prematurely: srsepc(pid=16323) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16323)] FAIL: rrc_idle_mo_ping.py (18.0 sec) Error: srsepc(pid=16339): Process ended prematurely: srsepc(pid=16339) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16339)] FAIL: rrc_idle_mt_ping.py (18.4 sec) Error: srsepc(pid=16356): Process ended prematurely: srsepc(pid=16356) [trial-2375↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16356)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16371): Process ended prematurely: osmo-stp_10.42.42.5(pid=16371) [trial-2375↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16371)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16386): Process ended prematurely: osmo-stp_10.42.42.5(pid=16386) [trial-2375↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16386)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16400): Process ended prematurely: osmo-stp_10.42.42.5(pid=16400) [trial-2375↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16400)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16414): Process ended prematurely: osmo-stp_10.42.42.5(pid=16414) [trial-2375↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16414)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16428): Process ended prematurely: osmo-stp_10.42.42.5(pid=16428) [trial-2375↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16428)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16442): Process ended prematurely: osmo-stp_10.42.42.5(pid=16442) [trial-2375↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16442)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16459): Process ended prematurely: osmo-stp_10.42.42.5(pid=16459) [trial-2375↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16459)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16473): Process ended prematurely: osmo-stp_10.42.42.5(pid=16473) [trial-2375↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16473)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16487): Process ended prematurely: osmo-stp_10.42.42.5(pid=16487) [trial-2375↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16487)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16502): Process ended prematurely: osmo-stp_10.42.42.5(pid=16502) [trial-2375↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16502)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16516): Process ended prematurely: osmo-stp_10.42.42.5(pid=16516) [trial-2375↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16516)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16530): Process ended prematurely: osmo-stp_10.42.42.5(pid=16530) [trial-2375↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16530)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16544): Process ended prematurely: osmo-stp_10.42.42.5(pid=16544) [trial-2375↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16544)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16558): Process ended prematurely: osmo-stp_10.42.42.5(pid=16558) [trial-2375↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16558)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16572): Process ended prematurely: osmo-stp_10.42.42.5(pid=16572) [trial-2375↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16572)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16586): Process ended prematurely: osmo-stp_10.42.42.5(pid=16586) [trial-2375↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16586)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16600): Process ended prematurely: osmo-stp_10.42.42.5(pid=16600) [trial-2375↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16600)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16615): Process ended prematurely: osmo-stp_10.42.42.5(pid=16615) [trial-2375↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16615)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16629): Process ended prematurely: osmo-stp_10.42.42.5(pid=16629) [trial-2375↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16629)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16644): Process ended prematurely: osmo-stp_10.42.42.5(pid=16644) [trial-2375↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16644)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16659): Process ended prematurely: osmo-stp_10.42.42.5(pid=16659) [trial-2375↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16659)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16673): Process ended prematurely: osmo-stp_10.42.42.5(pid=16673) [trial-2375↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16673)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16688): Process ended prematurely: osmo-stp_10.42.42.5(pid=16688) [trial-2375↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16688)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16702): Process ended prematurely: osmo-stp_10.42.42.5(pid=16702) [trial-2375↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16702)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16716): Process ended prematurely: osmo-stp_10.42.42.5(pid=16716) [trial-2375↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16716)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16730): Process ended prematurely: osmo-stp_10.42.42.5(pid=16730) [trial-2375↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16730)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16745): Process ended prematurely: osmo-stp_10.42.42.5(pid=16745) [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16745)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16764): Process ended prematurely: osmo-stp_10.42.42.5(pid=16764) [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16764)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16778): Process ended prematurely: osmo-stp_10.42.42.5(pid=16778) [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16778)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16792): Process ended prematurely: osmo-stp_10.42.42.5(pid=16792) [trial-2375↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16792)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16806): Process ended prematurely: osmo-stp_10.42.42.5(pid=16806) [trial-2375↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16806)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16820): Process ended prematurely: osmo-stp_10.42.42.5(pid=16820) [trial-2375↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16820)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16837): Process ended prematurely: osmo-stp_10.42.42.5(pid=16837) [trial-2375↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16837)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16851): Process ended prematurely: osmo-stp_10.42.42.5(pid=16851) [trial-2375↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16851)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16865): Process ended prematurely: osmo-stp_10.42.42.5(pid=16865) [trial-2375↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16865)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16879): Process ended prematurely: osmo-stp_10.42.42.5(pid=16879) [trial-2375↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16879)] + rm -rf trial-2375/inst + cd trial-2375 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-10 12:41:51 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375-run.tgz run.2022-12-10_12-42-03 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2375-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17660.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6681.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2957.tgz osmo-mgw.build-8947.tgz osmo-msc.build-29271.tgz osmo-nitb.build-12971.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30049.tgz osmo-stp.build-9242.tgz osmo-trx.build-4677.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE